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What Is NAEP? 



T he National Assessment of Educational Progress (NAEP) is a congressionally mandated project of the U.S. De- 
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The National Assessment Governing Board 
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the Board’s responsibilities are developing objectives and test specifications, and designing the assessment method- 
ology for NAEP. 
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Chapter One: Overview of Recommendations 



Introduction 

S ince 1973 the National Assessment of Educational Progress (NAEP) has gathered informa- 
tion about student achievement in mathematics. The results of these periodic assessments, 
produced in print and Web-based formats, inform citizens about the nature of students’ 
comprehension of the subject, inform curriculum specialists about the level and nature of stu- 
dent understanding, and inform policymakers about factors related to schooling and its effect 
on student proficiency in mathematics. 

Based on these surveys of students at the elementary, middle school, and high school levels, 
NAEP has provided comprehensive information about what students in the United States know 
and can do in the area of mathematics, as well as in a number of other subject areas. These re- 
ports present information on strengths and weaknesses in students’ understanding and their abili- 
ty to apply that understanding in problemsolving situations; provide comparative student data 
according to race/ethnicity, type of community, and geographic region; describe trends in stu- 
dent performance over time; and report on relationships between student proficiency and certain 
background variables. 

This document contains the framework and a set of recommendations for the 2005 NAEP math- 
ematics assessment. It includes descriptions of the mathematical content of the test, the types of 
test questions, and recommendations for administration of the test. In broad terms, this framework 
attempts to answer the question: What mathematics should be assessed in 2005 on NAEP? The an- 
swer to this question must necessarily take into account the constraints of a large-scale assessment 
such as NAEP, with its limitations on time and resources. Of critical importance is the fact that this 
document does not attempt to answer the question: What mathematics should be taught (or how)? 
This is an assessment framework, not a curriculum framework. It was developed with the under- 
standing that some concepts, skills, and activities in school mathematics are not suitable to be as- 
sessed on NAEP, even though they may be important components of a school curriculum. (An 
example would be an extended project that involves gathering data, or a group project.) 

The Assessment and Item Specifications for the 2005 NAEP Mathematics Assessment, a com- 
panion document to this framework, gives more detail about the items and conditions for the 
2005 NAEP mathematics assessment. 

Note: To comply with the provisions of the No Child Eeft Behind Act of 2001, the National 
Assessment Governing Board (NAGB) adopted a revised NAEP assessment schedule in March 
2002. This schedule moved the 2004 mathematics assessment to 2005 because NAEP will test 
mathematics and reading in odd-numbered years. 

Context for Planning the 2005 Assessment 

The National Assessment Governing Board, created by Congress in 1988, is responsible for 
formulating policy for NAEP. NAGB is specifically charged with developing assessment objec- 
tives and test specifications, identifying appropriate achievement goals for each age and grade, 
and carrying out other NAEP policy responsibilities. 
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Congress also authorized the trial state assessment program (more commonly known as the 
state NAEP program) in 1988. The voluntary trial state NAEP began with the 1990 assessment 
of mathematics at grade 8; the state NAEP program continued with the 1992 mathematics assess- 
ment at grades 4 and 8. The regular national mathematics assessment of students at grades 4, 8, 
and 12 also occurred in 1990 and 1992. 

In preparation for the 1990 mathematics assessment, a contract was awarded to the Council of 
Chief State School Officers (CCSSO) to design a framework for the assessment. The CCSSO 
project gave special attention to the formal state objectives and frameworks for mathematics in- 
struction. As a part of the work, state-, district-, and school-level objectives were considered, as 
well as the frameworks on which previous NAEP mathematics assessments had been based and 
a draft version of the National Council of Teachers of Mathematics’ (NCTM’s) Curriculum and 
Evaluation Standards for School Mathematics. The result was a “content by mathematical ability” 
matrix design that was used to guide both the 1990 and 1992 mathematics assessments conducted 
by NAEP at the national and state levels. The design was reported in Mathematics Objectives: 
1990 Assessment. 

To prepare for the next NAEP mathematics assessment, NAGB awarded a contract in fall 1991 
to the College Board to develop the assessment and item specifications for the 1994 mathemat- 
ics assessment. The College Board work was completed between September 1991 and March 
1992. Due to a budget shortfall, the 1994 mathematics assessment and the science assessment 
were rescheduled for 1996. 

The NAEP mathematics project conducted by the College Board had two primary purposes: 
(1) to recommend a framework for the overall design of the mathematics assessment — a structure 
for describing what students know and can do in mathematics, and (2) to develop specifications 
for the assessment items, paying particular attention to the mix of item formats, the item distri- 
bution for content areas within mathematics, and the conditions under which items are presented 
to students (for example, use of manipulatives, use of calculators, and time to complete tasks). 
The work of the project was also to be considered in light of the three NAEP achievement levels 
adopted by NAGB — Basic, Proficient, and Advanced. 

The College Board effort resulted in the “content areas by mathematical abilities by mathemat- 
ical power” grid that was used to guide the development of the 1996 and 2000 national and state 
mathematics assessments conducted by NAEP. The design was reported in Mathematics Frame- 
work for the 1996 and 2000 National Assessment of Educational Progress. The 1996/2000 Erame- 
work was used in the design of the assessments for those years. Those assessments maintained 
the trend lines that began in 1990. 

Other changes have taken place in NAEP in recent years. A number of policy, legislative, civil 
rights, and technical considerations caused NAEP to look more closely at its administration and 
assessment procedures and to consider implementing changes that can increase participation 
among students with disabilities and limited-English-proficient students. In the early 1990s, par- 
ticipation of these students in NAEP was limited, with schools excluding them from the assess- 
ment in accordance with criteria provided by the program at that time. This exclusion raised 
concerns that some special-needs students who could be meaningfully assessed were being ex- 
cluded from NAEP. 
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In the mid-1990s, based on requirements from the reauthorization of the Individuals with Dis- 
abilities Education Act (IDEA), the general trend of state assessments toward more inclusion of 
special-needs students, and recommendations from various offices of the U.S. Department of 
Education, NAEP modified its procedures with the aim of increasing the participation of special- 
needs students. Eor the 1996 assessment, modifications were made in two areas: inclusion crite- 
ria were revised to make them clearer, more inclusive, and more likely to be applied consistently 
across jurisdictions in the United States; and a variety of assessment accommodations was offered 
for the first time. This shift toward greater inclusiveness allowed NAEP to be more similar to 
state and district testing policies. NAEP used a split-sample approach to study the changes made 
and their possible impact on trends, and issued several reports from their findings (see Olson 
and Goldstein, 1997; Reese et ah, 1997; Mazzeo et ah, 1999). 

In the late 1990s, states had implemented assessments that included most, if not all, of their 
students and were beginning to report assessment results that included the performance of special- 
needs students. An array of assessment accommodations was being offered by states routinely, 
and by NAEP as well. In 1998, NAEP began new trend lines for some subject areas that presented 
data reported for the first time on samples that included accommodated special-needs students. 

In 2000, NAEP reported the mathematics assessment results for the first time on both a non- 
accommodated sample of students as well as a sample of regular and special-needs students who 
received accommodations in The Nation’s Report Card: Mathematics 2000 (Braswell et ah, 2001). 

This trend toward more inclusive assessments has also led to a closer look at how test items are 
developed and assessments designed. Over the years, NAEP has implemented procedures that are 
designed to make items more accessible for a variety of special- needs students. The 2005 math- 
ematics framework enables the continuation of this best practices approach, and the assessment 
and item specifications document (Assessment and Item Specifications for the 2005 NAEP Math- 
ematics Assessment) provides clear and detailed guidance on how to develop a more inclusive 
assessment. 

The long-range plan established by NAGB called for the development of a new mathematics 
framework to be used as the basis for the 2005 national and state assessments of mathematics. 
Prior to initiating work on a new framework, the Governing Board conducted a series of public 
meetings to gather input to serve as the basic purpose(s) for the new framework. At the public 
meetings, a strong concern was raised by states about the need to continue the short-term trend 
lines for the nation (at grades 4, 8, and 12) and the states (at grade 8 and later grade 4) that began 
with the 1990 mathematics assessment. The short-term trend lines were being used by many states 
as an independent monitor of their standards-based reform efforts. 

Several other concerns were also raised. Had computational skills been overlooked by the re- 
form efforts because of the emphasis placed on higher order skills by most state mathematics 
standards and the work by NCTM? Were U.S. students capable of handling a more rigorous cur- 
riculum, especially algebra and geometry, at grade 8? What should our mathematical expecta- 
tions be for grade 12 students? 

Based on the input received, the Governing Board awarded a contract to CCSSO in September 
2000 to update the mathematics assessment framework used for the 1996 and 2000 assessments. 
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The revisions were to address the concerns raised at the public meetings while maintaining the 
short-term trend lines in grades 4 and 8 that began with the 1990 mathematics assessment. 

It is within this context that the recommendations contained in this document were developed. 

The Consensus Approach 

The CCSSO established a steering committee, representative of national policy organizations, 
mathematics associations, research mathematicians, business and industry, and educators, to de- 
velop policy recommendations for the mathematics assessment and to guide the direction and 
scope of the project. A planning committee of mathematics educators, mathematicians, curricu- 
lum supervisors, and teachers was established to draft the content of the framework, working 
within the policy recommendations established by the steering committee. Care was taken with 
both committees to ensure that the diversity of opinion regarding mathematics issues was repre- 
sented and reflected. To reach meaningful consensus, all points of view were heard and consid- 
ered. Such consensus has been the goal of this project. 

A technical advisory panel, composed of university professors, state testing specialists, and 
measurement experts from private research organizations, was established to consider the policy 
recommendations and to draft content from the perspective of whether it would threaten NAEP’s 
ability to continue the short-term mathematics trend lines that began in 1990. The members of 
all three committees and project staff are presented in appendix C. 

The steering committee and planning committee both began their work with a review of the 
framework used for the 1996 and 2000 assessments. A discussion of the current debates in math- 
ematics education was also part of their meetings. In their deliberations, the committees consid- 
ered state mathematics content standards and frameworks, new standards prepared by NCTM, 
reports from the Third International Mathematics and Science Study, reports from the Achieve 
Project, and the recent report issued by the National Research Council of the National Academy 
of Sciences, Adding It Up (Findell et ah, 2001). In addition, input was provided by mathematics 
teachers and supervisors as well as others through CCSSO’s partners, the Council for Basic Ed- 
ucation and the Association of State Supervisors of Mathematics. 

The suggested revisions contained in the framework for the 2005 mathematics assessments 
are intended (1) to reflect recent curricular emphases and objectives; (2) to include what various 
policymakers, scholars, practitioners, and interested citizens believe should be in the assessment; 
(3) to maintain the short-term trend lines in grades 4 and 8 that began with the 1990 mathemat- 
ics assessment to permit the reporting of changes in student achievement over time; and (4) to 
include clearer and more specific objectives for each grade level. 

Achievement Levels 

The updated NAEP Mathematics Framework was considered in light of the three NAEP 
achievement levels: Basic, Proficient, and Advanced. Basic denotes partial mastery of prerequi- 
site knowledge and skills that are fundamental for proficient work at each grade. Proficient rep- 
resents solid academic performance for each grade assessed. Students reaching this level have 
demonstrated competency over challenging subject matter, including subject-matter knowledge. 
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application of such knowledge to real-world situations, and analytical skills appropriate to the 
subject matter. Advanced represents superior performance. These levels are intended to provide 
descriptions of what students should know and be able to do in mathematics. Established for the 
1992 mathematics scale through a broadly inclusive process and adopted by NAGB, the three 
levels per grade are a major means of reporting NAEP data. The updated mathematics frame- 
work was developed with these levels in mind to ensure congruence between the levels and the 
test content. See appendix A for the NAEP Mathematics Achievement Eevel Descriptions. Note: 
Since the grade 12 NAEP mathematics assessment will start a new trend line, the achievement 
level descriptions will change for this grade. New achievement level descriptions will be final- 
ized in late 2004. 

Recommendations for the 2005 NAEP Mathematics Assessment 

As a result of analysis and review, the steering committee and planning committee endorsed 
the following recommendations for the 2005 NAEP mathematics assessment: 

1. Content Areas 

The 2005 NAEP mathematics assessment should be based on essentially the same five content 
areas as the 1996 and 2000 assessments: (1) Number Properties and Operations, (2) Measurement, 
(3) Geometry, (4) Data Analysis and Probability, and (5) Algebra. Details about each of these 
content areas can be found in chapter 3. 

2. Mathematical Complexity of Items 

The second dimension of the framework, formerly known as “mathematical abilities,” should 
be refined to describe the level of mathematical complexity that an item demands of a student. 
Each level describes the degree of procedural knowledge, conceptual understanding, problem- 
solving, reasoning, or communicating required to respond to an item at that level. Eurther de- 
scription of how this revision relates to the former framework is presented in chapter 2, and the 
levels are described at length in chapter 4. 

3. Distribution of Items 

The percentage of items allotted to each of the five content areas should remain the same at 
grade 4 as called for in the framework for the 1996 and 2000 assessments. The percentages for 
grade 8 should be altered somewhat in the areas of Number Properties and Operations and Alge- 
bra to reflect the increasing importance of algebraic concepts. At grade 12, the percentages should 
be changed to more closely correspond to the mathematics that high school students experience 
in a typical 3-year sequence of courses, with algebra and geometry/measurement forming the 
anchors, along with an increasing emphasis on data analysis and probability. The specific rec- 
ommended percentages are discussed in chapter 2. 

4. Item Formats 

Given that NAEP is a paper-and-pencil test administered in a timed setting (for students not 
receiving accommodations), the assessment should continue to use three types of items: multiple 
choice, short constructed response, and extended constructed response. As in the previous frame- 
work, approximately half of a student’s testing time should be allotted to multiple-choice items. 
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with the remaining half devoted to constructed-response items of both types. Further description 
of the item formats can be found in chapter 5. For items with multiple-score points, students 
receive full credit only if they fulfill all the requirements of the item and provide the correct 
solution. 

5. Special Study 

A special study should be designed to probe grade 8 students’ understanding of mathematical 
topics that are critical for further study of algebra and more advanced mathematics. The study 
would answer questions about the depth of students’ knowledge of such algebraic ideas as rate 
of change and variable, and their understanding of proportionality. Further discussion of this 
special study is provided in chapter 2. 

6. Manipulatives 

The assessment should continue to utilize reasonable manipulative materials, where possible, 
in measuring students’ ability to represent their understandings and to use tools to solve prob- 
lems. Such manipulative materials and accompanying tasks should be carefully chosen to cause 
minimal disruption of the test administration process. 

7. Calculators 

It is appropriate for some portions (two-thirds) of the NAEP at all grade levels to assess students’ 
mathematical knowledge and skills without access to a calculator, but for other portions (one- 
third) of the test to allow the use of a calculator. At grade 4, a four-function calculator should be 
supplied by NAEP with appropriate training at the time of administration. Eighth- and twelfth- 
grade students should be allowed to bring whatever calculator, graphing or otherwise, they are 
accustomed to using in the classroom. More details and discussion about the calculator recom- 
mendations can be found in chapter 2. Note: NAGB determined that eighth-grade students will 
be provided with scientific calculators for the 2005 assessment based on a survey of state testing 
programs. 
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Chapter Two: Framework for the Assessment 



T his chapter further discusses the rationale for recommendations, especially those that 
reflect a change from current policy. 

Content Areas 

Since its first mathematics assessments in the late 1970s and early 1980s, NAEP has regularly 
gathered data on students’ understanding of mathematical content. Although the names of the 
content areas in the frameworks, as well as some of the topics in those areas, may have changed 
somewhat from one assessment to the next, there remained a consistent focus toward collecting 
information on student performance in five key areas: 

• Number (including computation and the understanding of number concepts) 

• Measurement (including use of instruments, application of processes, and concepts of area 
and volume) 

• Geometry (including spatial reasoning and applying geometric properties) 

• Data Analysis (including probability, graphs, and statistics) 

• Algebraic Representations and Relationships 

The framework for the 2005 mathematics assessment is anchored in these same five broad 
areas of mathematical content: 

• Number Properties and Operations 
• Measurement 
• Geometry 

• Data Analysis and Probability 
• Algebra 

These divisions are not intended to separate mathematics into discrete elements. Rather, they 
are intended to provide a helpful classification scheme that describes the full spectrum of mathe- 
matical content assessed by NAEP. Classifying items into one primary content area is not always 
clear cut, but doing so brings us closer to the goal of ensuring that important mathematical con- 
cepts and skills are assessed in a balanced way. 

At grade 12, the five content areas are collapsed into four, with geometry and measurement 
combined into one. This reflects the fact that the majority of measurement topics suitable for 
12th-grade students are geometrical in nature. Separating these two areas of mathematics at 
grade 12 becomes forced and unnecessary. 

It is important to note that certain aspects of mathematics occur in all of the content areas. 

The best example of this is computation. Computation is the skill of performing operations on 
numbers. It should not be confused with the content area of NAEP called Number Properties 
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and Operations, which encompasses a wide range of concepts about our numeration system (see 
chapter 3 for a thorough discussion). Certainly the area of Number Properties and Operations in- 
cludes a variety of computational skills, ranging from operations with whole numbers to work 
with decimals and fractions and finally real numbers. But computation is also critical in Measure- 
ment and Geometry, such as in calculating the perimeter of a rectangle, estimating the height of a 
building, or finding the hypotenuse of a right triangle. Data analysis often involves computation, 
such as calculating a mean or the range of a set of data. Probability often entails work with ra- 
tional numbers. Solving algebraic equations usually involves numerical computation as well. 
Computation, therefore, is a foundational skill in every content area. While the main NAEP as- 
sessment is not designed to report a separate score for computation, results from the long-term 
NAEP assessment can provide insight into students’ computational abilities. 

Mathematical Complexity of Items 

The framework used for the 1996 and 2000 NAEP included three dimensions: mathematical 
content, mathematical abilities, and power (reasoning, connections, and communication). That 
framework was intended to address the primary need of making sure that NAEP assessed an ap- 
propriate balance of mathematical content and at the same time assessed a variety of ways of 
knowing and doing mathematics. The abilities and power dimensions were not intended for re- 
porting, but rather to provide for a wide range of mathematical activity in the items. 

There were many laudable features of that framework. Notions of conceptual understanding, 
procedural knowledge, and problemsolving sent a strong message about the depth and breadth 
of engaging in mathematical activity. The dimensions of mathematical power gave further em- 
phasis to the idea that certain activities cut across content areas. At the same time, there was 
an acknowledgement that the dimension of mathematical abilities proved somewhat difficult 
for experts to agree on, relying as it does on inferences about students’ approaches to each par- 
ticular item. 

The intent of the 2005 framework is to build on the former framework, retaining its strengths 
while addressing some of its weaknesses. The purpose remains the same: to make sure that 
NAEP assesses an appropriate balance of content as well as a variety of ways of knowing and 
doing mathematics. The major change is to create a second dimension of the framework based 
on the properties of an item, rather than on the abilities of a student. Mathematical complexity 
of an item answers the question, “What does the item ask of the students?” 

Each level of complexity includes aspects of knowing and doing mathematics, such as reason- 
ing, performing procedures, understanding concepts, or solving problems. The levels are or- 
dered, so that items at a low level would demand that students perform simple procedures, 
understand elementary concepts, or solve simple problems. Items at the high end would ask stu- 
dents to reason or communicate about sophisticated concepts, perform complex procedures, or 
solve nonroutine problems. Ordering of the levels is not intended to imply a developmental se- 
quence or the sequencing in which teaching or learning occur. Rather, it is a description of the 
different demands made on students by particular test items. See chapter 5 for further discussion 
of the levels of mathematical complexity. 




Distribution of Items 

The distribution of items among the various mathematical content areas is a critical feature of 
the assessment design, as it reflects the relative importance and value given to each of the cur- 
ricular content areas within mathematics. As has been the case with past NAEP assessments in 
mathematics, the categories have received differential emphasis at each grade, and the differenti- 
ation continues in the framework for the 2005 assessment. Table 1 provides the recommended 
balance of items in the assessment by content area for each grade (4, 8, and 12) in the 2005 as- 
sessment. Note that the percentages refer to numbers of items, not the amount of student testing 
time (see chapter 5 for recommendations on item formats and student testing time). 



Table 1. Percentage Distribution of Items by Grade and Content Area 



Content Area (2005) 


Grade 4 (%) 


Grade 8 (%) 


Grade 12 (%) 


Number Properties and Operations 


40 


20 


10 


Measurement 


20 


15 


30 


Geometry 


15 


20 


Data Analysis and Probability 


10 


15 


25 


Algebra 


15 


30 


35 



The percentages in grade 4 are not different from those recommended in the framework for 
the 1996 and 2000 assessments. Change was not recommended, as these numbers continue to be 
a reasonable reflection of the relative weights of each of these content areas at that grade level. 

At grade 8, new number concepts occur in the form of more advanced work with properties 
and operations on rational numbers (fractions and decimals) and more sophisticated work in 
number theory. However, much of the work in numbers happens in the context of other content 
areas, such as Measurement and Data Analysis and Probability. Grade 8 also has an increased 
emphasis on informal algebraic concepts and on Geometry. Therefore, the percentages show a 
slight increase in Algebra and a corresponding slight decrease in Number Properties and Opera- 
tions at grade 8 compared with the percentages of the previous framework. 

More students are taking higher levels of mathematics in high school. According to data from 
the 2000 NAEP, approximately 79 percent of 12th-grade students have taken the equivalent of 
2 years of algebra and 1 year of geometry. Because NAEP needs to assess the full range of con- 
tent in mathematics, the percentages for 12th grade have been adjusted, with primary emphasis 
on Geometry /Measurement and Algebra. At this grade level, the majority of measurement topics 
are geometrical in nature and the distinction between Geometry and Measurement becomes 
blurred, so the 2005 framework calls for these two content areas to be combined into one. The 
percentages also show the increased importance of Data Analysis and Probability in the second- 
ary school curriculum. The majority of work in Number Properties and Operations is done in 
the context of the other content areas, so it receives a decreased emphasis. 
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Special Study at Grade 8 

The past decade has brought major changes to the middle school mathematics curriculum in 
the form of more students taking courses called algebra and more algebraic concepts being taught 
in other mathematics courses at grades 7 and 8. From the 2000 NAEP assessment, we know that 
31 percent of eighth graders reported taking prealgebra and 26 percent reported taking either first- 
or second-year algebra. We have also learned from research and from international studies such 
as Trends in International Mathematics and Science Study that the topic of proportionality is 
particularly challenging for students around the world. Proportionality (such as “a is to Z? as c is 
to d') is foundational for understanding many algebraic concepts, such as rate of change, varia- 
tion, linear relationships, slope, and functions, as well as concepts in other advanced mathemat- 
ics courses and in other disciplines. Taken together, these two findings form the basis for the 
purpose of a special study of grade 8 students: to examine the depth and breadth of eighth-grade 
students’ understanding of proportionality and other fundamental topics in algebra. 

The special study would be designed to answer two research questions: 

1. What is the depth of understanding by grade 8 students of fundamental topics in algebra? 

2. What is the depth of understanding by grade 8 students of proportionality? 

Items for the special study should be administered to a random sample of eighth-grade stu- 
dents who also participate in regular NAEP. The items would be administered along with the 
main NAEP items, but in separate blocks, so that only a subset of students is taking special 
study items. 

Because the main NAEP assessment is designed to assess all five content areas of mathemat- 
ics at grade 8, it is not possible to obtain indepth data about students’ understanding of funda- 
mental topics in algebra or proportionality. This special study would provide an opportunity to 
more closely study students’ mathematical development in proportionality and related topics in 
algebra during the critical middle school years. It would also yield a clearer description of the 
depth and breadth of grade 8 students’ knowledge in these areas, which would be helpful in the 
design of future NAEP frameworks. 

Calculators 

At each grade level, approximately two-thirds of the assessment measures students’ mathe- 
matical knowledge and skills without access to a calculator; the other third of the assessment 
allows the use of a calculator. The assessment contains blocks for which calculators are not al- 
lowed, and calculator blocks, which contain some items that would be difficult to solve without 
a calculator. The type of calculator students may use on a calculator block varies by grade level, 
as follows: 

• At grade 4, a four-function calculator is supplied to students, with training at the time of 
administration. 

• At grade 8, a scientific calculator is supplied to students, with training at the time of 
administration. 
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• At grade 12, students should be allowed to bring whatever calculator, graphing or other- 
wise, they are accustomed to using in the classroom with some restrictions for test security 
purposes (see below). For students who do not bring a calculator to use on the assessment, 
NAEP will provide a scientific calculator. 

No items on the 2005 NAEP at either grade 8 or grade 12 will be designed to provide an ad- 
vantage to students with a graphing calculator. The estimated time required for any item should 
be based on the assumption that students are not using a graphing calculator. 

In determining whether an item belongs on a calculator block or a noncalculator block, the 
developer should take into consideration the technology available to students and the measure- 
ment intent of the item. The content and skills being assessed should guide whether an item 
should be considered calculator active and whether it should go in a calculator block. Eor exam- 
ple, a multiple-choice item asking students to select the graph that represents a given equation 
should be on a noncalculator block, if the intent of the item is to measure students’ ability to 
recognize the graph of a given equation and if the equation is in a form that is readily entered 
into a graphing calculator to obtain a graph (for example, y = -x^). 



11 




Chapter Three: 2005 NAEP Mathematics 
Objectives 



I n order to describe the specific mathematics that should be assessed at each grade level, it is 
necessary to organize the domain of mathematics into component parts. This is accomplished 
by utilizing the five content areas, as described in chapter 2. Though such an organization 
brings with it the danger of fragmentation, the hope is that the objectives and the test items built 
on them will, in many cases, cross some of the boundaries of these content areas. 

One of the goals of this framework is to provide more clarity and specificity in the objectives 
for each grade level. To accomplish this, a matrix was created that depicts the particular objec- 
tives that are appropriate for assessment under each subtopic. Within Number, for example, and 
the subtopic of Number Sense, specific objectives are listed for assessment at grade 4, grade 8, 
and grade 12. The same objective at different grade levels depicts a developmental sequence for 
that concept or skill. An empty cell in the matrix is used to convey the fact that a particular ob- 
jective is not appropriate for assessment at that grade level. 



In order to fully understand the objectives and their intent, please note the following: 

• Further clarification of some of these objectives, along with some sample items, may 
be found in the companion document. Assessment and Item Specifications for the 2005 
NAEP Mathematics Assessment. 

• While all test items will be assigned a primary classification, some test items could 
potentially fall into more than one content area or more than one objective. 

• When the word “or” is used in an objective, it should be understood as inclusive; that 
is, an item may assess one or more of the concepts included. However, all concepts 
described should be measured across the full range of the assessment. 

• These objectives describe what is to be assessed on the 2005 NAEP. They should not 
be interpreted as a complete description of mathematics that should be taught at these 
grade levels. 



Mathematical Content Areas 

Number Properties and Operations 

Numbers are our main tools for describing the world quantitatively. As such, they deserve a 
privileged place in the 2005 NAEP framework. With whole numbers, we can count collections 
of discrete objects of any type. We can also use numbers to describe fractional parts and even 
to describe continuous quantities such as length, area, volume, weight, and time, and more com- 
plicated derived quantities such as rates, speed, density, inflation, interest, and so forth. Thanks 
to Cartesian coordinates, we can use pairs of numbers to describe points in a plane or triples of 
numbers to label points in space. Numbers let us talk in a precise way about anything that can 
be counted, measured, or located in space. 
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Numbers are not simply labels for quantities. They form systems with their own internal struc- 
ture. The arithmetic operations (addition and subtraction, multiplication and division) help us 
model basic real-world operations. For example, joining two collections, or laying two lengths 
end to end, can be described by addition, while the concept of rate depends on division. Multipli- 
cation and division of whole numbers lead to the beginnings of number theory, including con- 
cepts of factorization, remainder, and prime number. Besides the arithmetic operations, the other 
basic structure of the real numbers is ordering, as in which is greater and lesser. These reflect our 
intuitions about the relative size of quantities, and provide a basis for making sensible estimates. 

The accessibility and usefulness of arithmetic are greatly enhanced by our efficient means for 
representing numbers: the Hindu- Arabic decimal place value system. In its full development, this 
remarkable system includes decimal fractions, which let us approximate any real number as close- 
ly as we wish. Decimal notation allows us to do arithmetic by means of simple, routine algorithms, 
and it also makes size comparisons and estimation easy. The decimal system achieves its efficien- 
cy through sophistication, as all the basic algebraic operations are implicitly used in writing 
decimal numbers. To represent ratios of two whole numbers exactly, we supplement decimal 
notation with fractions. 

Comfort in dealing with numbers effectively is called number sense. It includes firm intu- 
itions about what numbers tell us; an understanding of the ways to represent them symbolically 
(including facility with converting between different representations); the ability to calculate, 
either exactly or approximately, and by several means (mentally, with paper and pencil, or with 
calculator, as appropriate); and skill in estimation. The ability to deal with proportion, including 
percents, is another important part of number sense. 

Number sense is a major expectation of the 2005 NAEP. At fourth grade, students are expect- 
ed to have a solid grasp of whole numbers, as represented by the decimal system, and to have 
the beginnings of understanding fractions. By eighth grade, they should be comfortable with ra- 
tional numbers, represented either as decimal fractions (including percents) or as common frac- 
tions. They should be able to use them to solve problems involving proportionality and rates. In 
middle school also, number should begin to coalesce with geometry via the idea of the number 
line. This should be connected with ideas of approximation and the use of scientific notation. 
Eighth graders should also have some acquaintance with naturally occurring irrational numbers, 
such as square roots and pi. By 12th grade, students should be comfortable dealing with all 
types of real numbers. 
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Number Properties and Operations 



1) Number sense 


GRADE 4 


GRADES 


GRADE 12 


a) Identify the place value and 
actual value of digits in whole 
numbers. 


a) Use place value to model and 
describe integers and decimals. 




b) Represent numbers using 
models such as base 10 rep- 
resentations, number lines, 
and two-dimensional models. 


b) Model or describe rational num- 
bers or numerical relationships 
using number lines and diagrams. 




c) Compose or decompose whole 
quantities by place value (e.g., 
write whole numbers in ex- 
panded notation using place 
value: 342 = 300 H- 40 H- 2). 






d) Write or rename whole numbers 
(e.g., 10:5 h-5, 12-2,2x5). 


d) Write or rename rational 
numbers. 


d) Write, rename, represent, or 
compare real numbers (e.g., tt, 
V2, numerical relationships 
using number lines, models, 
or diagrams). 


e) Connect model, number word, 
or number using various models 
and representations for whole 
numbers, fractions, and decimals. 


e) Recognize, translate between, 
or apply multiple representations 
of rational numbers (fractions, 
decimals, and percents) in 
meaningful contexts. 






f) Express or interpret numbers 
using scientific notation from 
real-life contexts. 


f) Represent very large or very 
small numbers using scientific 
notation in meaningful contexts. 




g) Find or model absolute value 
or apply to problem situations. 


g) Find or model absolute value 
or apply to problem situations. 






h) Interpret calculator or computer 
displays of numbers given in 
scientific notation. 




i) Order or compare rational num- 
bers (fractions, decimals, per- 
cents, or integers) using various 
models and representations 
(e.g., number line). 




j) Order or compare whole num- 
bers, decimals, or fractions. 


j) Order or compare rational num- 
bers including very large and 
small integers, and decimals 
and fractions close to zero. 


j) Order or compare real numbers, 
including very large or small 
real numbers. 



continued on page 16 
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Number Properties and Operations (continued) 



2) Estimation 


GRADE 4 


GRADES 


GRADE 12 


a) Use benchmarks (well-known 
numbers used as meaningful 
points for comparison) for whole 
numbers, decimals, or fractions 
in contexts (e.g., M and .5 may 
be used as benchmarks for frac- 
tions and decimals between 0 
and 1.00). 


a) Establish or apply benchmarks 
for rational numbers and com- 
mon irrational numbers (e.g., tt) 
in contexts. 


a) Establish or apply benchmarks 
for real numbers in contexts. 


b) Make estimates appropriate to a 
given situation with whole num- 
bers, fractions, or decimals by: 

• knowing when to estimate, 

• selecting the appropriate type 
of estimate, including over- 
estimate, underestimate, and 
range of estimate, or 

• selecting the appropriate 
method of estimation (e.g., 
rounding). 


b) Make estimates appropriate to 

a given situation by: 

• identifying when estimation 
is appropriate, 

• determining the level of accu- 
racy needed, 

• selecting the appropriate 
method of estimation, or 

• analyzing the effect of an 
estimation method on the 
accuracy of results. 


b) Make estimates of very large or 
very small numbers appropriate 
to a given situation by: 

• identifying when estimation 
is appropriate or not, 

• determining the level of 
accuracy needed, 

• selecting the appropriate 
method of estimation, or 

• analyzing the effect of an 
estimation method on the 
accuracy of results. 


c) Verify solutions or determine 
the reasonableness of results 
in meaningful contexts. 


c) Verify solutions or determine 
the reasonableness of results in 
a variety of situations including 
calculator and computer results. 


c) Verify solutions or determine 
the reasonableness of results in 
a variety of situations including 
scientific notation, calculator, 
and computer results. 




d) Estimate square or cube roots 
of numbers less than 1 ,000 be- 
tween two whole numbers. 


d) Estimate square or cube roots 
of numbers less than 1 ,000 be- 
tween two whole numbers. 



continued on page 1 7 
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Number Properties and Operations (continued) 



3) Number operations 


GRADE 4 


GRADES 


GRADE 12 


a) Add and subtract: 

• whole numbers, or 

• fractions with like denomina- 
tors, or 

• decimals through hundredths. 


a) Perform computations with 
rational numbers. 


a) Perform computations with real 
numbers including common irra- 
tional numbers or the absolute 
value of numbers. 


b) Multiply whole numbers: 

• no larger than two-digit by 
two-digit with paper and pen- 
cil computation, or 

• larger numbers with use of 
calculator. 






c) Divide whole numbers: 

• up to three-digits by one-digit 
with paper and pencil compu- 
tation, or 

• up to five-digits by two-digits 
with use of calculator. 






d) Describe the effect of operations 
on size (whole numbers). 


d) Describe the effect of multiplying 
and dividing by numbers includ- 
ing the effect of multiplying or 
dividing a rational number by: 

• zero, or 

• a number less than zero, or 

• a number between zero and 
one, 

• one, or 

• a number greater than one. 


d) Describe the effect of multiply- 
ing and dividing by numbers in- 
cluding the effect of multiplying 
or dividing a real number by: 

• zero, or 

• a number less than zero, or 

• a number between zero and 
one, or 

• one, or 

• a number greater than one. 




e) Provide a mathematical argu- 
ment to explain operations with 
two or more fractions. 




f) Interpret whole number opera- 
tions and the relationships be- 
tween them. 


f) Interpret rational number opera- 
tions and the relationships be- 
tween them. 




g) Solve application problems in- 
volving numbers and operations. 


g) Solve application problems in- 
volving rational numbers and 
operations using exact answers 
or estimates as appropriate. 


g) Solve application problems in- 
volving numbers, including ra- 
tional and common irrationals, 
using exact answers or estimates 
as appropriate. 



continued on page 18 
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Number Properties and Operations (continued) 



4) Ratios and proportional reasoning 


GRADE 4 


GRADES 


GRADE 12 


a) Use simple ratios to describe 
problem situations. 


a) Use ratios to describe problem 
situations. 






b) Use fractions to represent and 
express ratios and proportions. 


b) Use proportions to model 
problems. 




c) Use proportional reasoning to 
model and solve problems (in- 
cluding rates and scaling). 


c) Use proportional reasoning to 
solve problems (including rates). 




d) Solve problems involving 
percentages (including percent 
increase and decrease, interest 
rates, tax, discount, tips, or 
part/whole relationships). 


d) Solve problems involving 
percentages (including percent 
increase and decrease, interest 
rates, tax, discount, tips, or 
part/whole relationships). 


5) Properties of number and operations 


GRADE 4 


GRADES 


GRADE 12 


a) Identify odd and even numbers. 


a) Describe odd and even integers 
and how they behave under dif- 
ferent operations. 




b) Identify factors of whole 
numbers. 


b) Recognize, find, or use factors, 
multiples, or prime factorization. 


b) Solve problems involving 
factors, multiples, or prime 
factorization. 




c) Recognize or use prime and 
composite numbers to solve 
problems. 


c) Use prime or composite numbers 
to solve problems. 




d) Use divisibility or remainders in 
problem settings. 


d) Use divisibility or remainders in 
problem settings. 


e) Apply basic properties of 
operations. 


e) Apply basic properties of 
operations. 


e) Apply basic properties of 
operations. 


f) Explain or justify a mathematical 
concept or relationship (e.g., ex- 
plain why 15 is an odd number 
or why 7-3 is not the same as 
3-7). 


f) Explain or justify a mathematical 
concept or relationship (e.g., 
explain why 17 is prime). 


f) Provide a mathematical argu- 
ment about a numerical property 
or relationship. 
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Measurement 

Measuring is the process by which numbers are assigned in order to describe the world quan- 
titatively. This process involves selecting the attribute of the object or event to be measured, com- 
paring this attribute to a unit, and reporting the number of units. For example, in measuring a 
child, we may select the attribute of height and the inch as the unit for the comparison. In com- 
paring the height to the inch, we may find that the child is about 42 inches. If considering only 
the domain of whole numbers, we would report that the child is 42 inches tall. However, since 
height is a continuous attribute, we may consider the domain of rational numbers and report 
that the child is 4% inches tall (to the nearest 16th of an inch). Measurement also allows us to 
model positive and negative numbers as well as irrational numbers. 

This connection between measuring and number makes measuring a vital part of the school 
curriculum. Measurement models are often used when students are learning about number and 
operations. For example, area and volume models can help students understand multiplication 
and the properties of multiplication. Length models, especially the number line, can help stu- 
dents understand ordering and rounding numbers. Measurement also has a strong connection to 
other areas of school mathematics and to the other subjects in the school curriculum. Problems 
in algebra are often drawn from measurement situations. One can also consider measurement to 
be a function or a mapping of the attribute to a set of numbers. Much of school geometry focus- 
es on the measurement aspect of geometric figures. Statistics also provides ways to measure and 
to compare sets of data. These are some of the ways in which measurement is intertwined with 
the other four content areas. 

In this NAEP Mathematics Framework, attributes such as capacity, weight/mass, time, and tem- 
perature are included, as well as the geometric attributes of length, area, and volume. Although 
many of these attributes are included in the grade 4 framework, the emphasis is on length, includ- 
ing perimeter, distance, and height. More emphasis is placed on area and angle in grade 8. By 
grade 12, volumes and rates constructed from other attributes, such as speed, are emphasized. 

Units involved in items on the NAEP assessment include nonstandard, customary, and metric 
units. At grade 4, common customary units such as inch, quart, pound, and hour and the com- 
mon metric units such as centimeter, liter, and gram are emphasized. Grades 8 and 12 include 
the use of both square and cubic units for measuring area, surface area, and volume; degrees for 
measuring angles; and constructed units such as miles per hour. Converting from one unit in a 
system to another (such as from minutes to hours) is an important aspect of measurement in- 
cluded in problem situations. Understanding and using the many conversions available is an im- 
portant skill. There are a limited number of common, everyday equivalencies that students are 
expected to know (see the Assessment and Item Specifications document for more detail). 

Items classified in this content area depend on some knowledge of measurement. Eor exam- 
ple, an item that asks the difference between a 3-inch and a 1%-inch line segment is a number 
item, while an item comparing a 2-foot segment with an 8-inch line segment is a measurement 
item. In many secondary schools, measurement becomes an integral part of geometry; this is re- 
flected in the proportion of items recommended for these two areas. 
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Measurement 



1) Measuring physical attributes 


GRADE 4 


GRADES 


GRADE 12 


a) Identify the attribute that is ap- 
propriate to measure in a given 
situation. 






b) Compare objects with respect to 
a given attribute, such as length, 
area, volume, time, or temperature. 


b) Compare objects with respect 
to length, area, volume, angle 
measurement, weight, or mass. 




c) Estimate the size of an object 
with respect to a given measure- 
ment attribute (e.g., length, 
perimeter, or area using a grid). 


c) Estimate the size of an object 
with respect to a given measure- 
ment attribute (e.g., area). 


c) Estimate or compare perimeters 
or areas of two-dimensional 
geometric figures. 






d) Estimate or compare volume 
or surface area of three- 
dimensional figures. 






e) Solve problems involving the 
coordinate plane such as the 
distance between two points, the 
midpoint of a segment, or slopes 
of perpendicular or parallel lines. 






f) Solve problems of angle meas- 
ure, including those involving 
triangles or other polygons or 
parallel lines cut by a transversal. 


g) Select or use appropriate measure- 
ment instruments such as ruler, 
meter stick, clock, thermometer, 
or other scaled instruments. 


g) Select or use appropriate meas- 
urement instrument to determine 
or create a given length, area, 
volume, angle, weight, or mass. 




h) Solve problems involving 
perimeter of plane figures. 


h) Solve mathematical or real-world 
problems involving perimeter or 
area of plane figures such as 
triangles, rectangles, circles, 
or composite figures. 


h) Solve mathematical or real- 
world problems involving 
perimeter or area of plane fig- 
ures such as polygons, circles, 
or composite figures. 


i) Solve problems involving area 
of squares and rectangles. 








j) Solve problems involving volume 
or surface area of rectangular 
solids, cylinders, prisms, or 
composite shapes. 


j) Solve problems involving vol- 
ume or surface area of rectan- 
gular solids, cylinders, cones, 
pyramids, prisms, spheres, or 
composite shapes. 



continued on page 21 
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Measurement (continued) 



1) Measuring physical attributes (continued) 


GRADE 4 


GRADES 


GRADE 12 




k) Solve problems involving indi- 
rect measurement such as finding 
the height of a building by com- 
paring its shadow with the height 
and shadow of a known object. 


k) Solve problems involving indi- 
rect measurement such as find- 
ing the height of a building by 
finding the distance to the base 
of the building and the angle of 
elevation to the top. 




1) Solve problems involving rates 
such as speed or population 
density. 


1) Solve problems involving rates 
such as speed, density, popula- 
tion density, or flow rates. 






mjUse trigonometric relations in 
right triangles to solve problems. 


2) Systems of measurement 


GRADE 4 


GRADES 


GRADE 12 


a) Select or use appropriate type 
of unit for the attribute being 
measured such as length, time, 
or temperature. 


a) Select or use appropriate type of 
unit for the attribute being meas- 
ured such as length, area, angle, 
time, or volume. 


a) Select or use appropriate type 
of unit for the attribute being 
measured such as volume or 
surface area. 


b) Solve problems involving conver- 
sions within the same measure- 
ment system such as conversions 
involving inches and feet or hours 
and minutes. 


b) Solve problems involving conver- 
sions within the same measure- 
ment system such as conversions 
involving square inches and 
square feet. 


b) Solve problems involving con- 
versions within or between 
measurement systems, given the 
relationship between the units. 




c) Estimate the measure of an object 
in one system given the measure 
of that object in another system 
and the approximate conversion 
factor. For example: 

• Distance conversion: 1 kilo- 
meter is approximately % of 
a mile. 

• Money conversion: US dollar 
is approximately 1.5 Canadian 
dollars. 

• Temperature conversion: 
Fahrenheit to Celsius 




d) Determine appropriate size of 
unit of measurement in problem 
situation involving such attributes 
as length, time, capacity, or 
weight. 


d) Determine appropriate size of 
unit of measurement in problem 
situation involving such attributes 
as length, area, or volume. 





continued on page 22 
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Measurement (continued) 



2) Systems of measurement (continued) 


GRADE 4 


GRADES 


GRADE 12 


e) Determine situations in which a 
highly accurate measurement is 
important. 


e) Determine appropriate accuracy 
of measurement in problem sit- 
uations (e.g., the accuracy of 
each of several lengths needed 
to obtain a specified accuracy of 
a total length) and find the meas- 
ure to that degree of accuracy. 


e) Determine appropriate accuracy 
of measurement in problem sit- 
uations (e.g., the accuracy of 
measurement of the dimensions 
to obtain a specified accuracy 
of area) and find the measure to 
that degree of accuracy. 




f) Construct or solve problems 
(e.g., floor area of a room) in- 
volving scale drawings. 


f) Construct or solve problems 
(e.g., number of rolls needed 
for insulating a house) involving 
scale drawings. 






g) Compare lengths, areas, or 
volumes of similar figures 
using proportions. 



Geometry 

Geometry began as a practical collection of rules for calculating lengths, areas, and volumes 
of common shapes. In classical times, the Greeks turned it into a subject for reasoning and 
proof, and Euclid organized their discoveries into a coherent collection of results, all deduced 
using logic from a small number of special assumptions called postulates. Euclid’s Elements 
stood as a pinnacle of human intellectual achievement for over 2000 years. 

The 19th century saw a new flowering of geometric thought, going beyond Euclid, and lead- 
ing to the idea that geometry is the study of the possible structures of space. This had its most 
striking application in Einstein’s theories of relativity, which describes the behavior of light, and 
also of gravity, in terms of a four-dimensional geometry, which combines the usual three dimen- 
sions of space with time as an additional dimension. 

A major insight of the 19th century is that geometry is intimately related to ideas of symmetry 
and transformation. The symmetry of familiar shapes under simple transformations (that our bod- 
ies look more or less the same if reflected across the middle, or that a square looks the same if 
rotated by 90 degrees) is a matter of everyday experience. Many of the standard terms for trian- 
gles (scalene, isosceles, equilateral) and quadrilaterals (parallelogram, rectangle, rhombus, square) 
refer to symmetry properties. Also, the behavior of figures under changes of scale is an aspect of 
symmetry with myriad practical consequences. At a deeper level, the fundamental ideas of geom- 
etry itself (for example, congruence) depend on transformation and invariance. In the 20th cen- 
tury, symmetry ideas were seen to also underlie much of physics, not only Einstein’s relativity 
theories, but atomic physics and solid-state physics (the field that produced computer chips). 
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School geometry roughly mirrors the historical development through Greek times with some 
modem additions, most notably symmetry and transformations. By grade 4, students are expected 
to be familiar with a library of simple figures and their attributes, both in the plane (lines, circles, 
triangles, rectangles, and squares) and in space (cubes, spheres, and cylinders). In middle school, 
understanding of these shapes deepens, with the study of cross-sections of solids and the begin- 
nings of an analytical understanding of properties of plane figures, especially parallelism, per- 
pendicularity, and angle relations in polygons. Right angles and the Pythagorean theorem are 
introduced, and geometry becomes more and more mixed with measurement. The basis for ana- 
lytic geometry is laid by study of the number line. In high school, attention is given to Euclid’s 
legacy and the power of rigorous thinking. Students are expected to make, test, and validate con- 
jectures. Via analytic geometry, the key areas of geometry and algebra are merged into a power- 
ful tool that provides a basis for calculus and the applications of mathematics that helped create 
the modern technological world in which we live. 

Symmetry is an increasingly important component of geometry. Elementary students are ex- 
pected to be familiar with the basic types of symmetry transformations of plane figures, includ- 
ing flips (reflection across lines), turns (rotations around points), and slides (translations). In 
middle school, this knowledge becomes more systematic and analytical, with each type of trans- 
formation being distinguished from other types by their qualitative effects. Eor example, a rigid 
motion of the plane that leaves at least two points fixed (but not all points) must be a reflection in 
a line. In high school, students are expected to be able to represent transformations algebraically. 
Some may also gain insight into systematic structure, such as the classification of rigid motions 
of the plane as reflections, rotations, translations, or glide reflections, and what happens when 
two or more isometries are performed in succession (composition). 
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Geometry 



1) Dimension and shape 


GRADE 4 


GRADES 


GRADE 12 


a) Explore properties of paths be- 
tween points. 


a) Draw or describe a path of 
shortest length between points 
to solve problems in context. 




b) Identify or describe (informally) 
real-world objects using simple 
plane figures (e.g., triangles, rec- 
tangles, squares, and circles) and 
simple solid figures (e.g., cubes, 
spheres, and cylinders). 


b) Identify a geometric object 
given a written description of its 
properties. 


b) Use two-dimensional represen- 
tations of three-dimensional 
objects to visualize and solve 
problems involving surface area 
and volume. 


c) Identify or draw angles and other 
geometric figures in the plane. 


c) Identify, define, or describe geo- 
metric shapes in the plane and in 
three-dimensional space given a 
visual representation. 


c) Give precise mathematical de- 
scriptions or definitions of geo- 
metric shapes in the plane and 
in three-dimensional space. 




d) Draw or sketch from a written 
description polygons, circles, or 
semicircles. 


d) Draw or sketch from a written 
description plane figures (e.g., 
isosceles triangles, regular poly- 
gons, curved figures) and planar 
images of three-dimensional fig- 
ures (e.g., polyhedra, spheres, 
and hemispheres). 




e) Represent or describe a three- 
dimensional situation in a two- 
dimensional drawing from 
different views. 


e) Describe or analyze properties 
of spheres and hemispheres. 


f) Describe attributes of two- and 
three-dimensional shapes. 


f) Demonstrate an understanding 
about the two- and three- 
dimensional shapes in our 
world through identifying, 
drawing, modeling, building, 
or taking apart. 





continued on page 25 
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Geometry (continued) 



2) Transformation of shapes and preservation of properties 


GRADE 4 


GRADES 


GRADE 12 


a) Identify whether a figure is 
symmetrical, or draw lines of 
symmetry. 


a) Identify lines of symmetry in 
plane figures or recognize and 
classify types of symmetries of 
plane figures. 


a) Recognize or identify types of 
symmetries (e.g., point, line, rota- 
tional, self-congruences) of two- 
and three-dimensional figures. 






b) Give or recognize the precise 
mathematical relationship (e.g., 
congruence, similarity, orienta- 
tion) between a figure and its 
image under a transformation. 


c) Identify the images resulting 
from flips (reflections), slides 
(translations), or turns (rotations). 


c) Recognize or informally describe 
the effect of a transformation on 
two-dimensional geometric 
shapes (reflections across lines of 
symmetry, rotations, translations, 
magnifications, and contractions). 


c) Perform or describe the effect of 
a single transformation on two- 
and three-dimensional geometric 
shapes (reflections across lines 
of symmetry, rotations, transla- 
tions, and dilations). 


d) Recognize which attributes (such 
as shape and area) change or 
don’t change when plane figures 
are cut up or rearranged. 


d) Predict results of combining, sub- 
dividing, and changing shapes 
of plane figures and solids (e.g., 
paper folding, tiling, and cutting 
up and rearranging pieces). 


d) Describe the final outcome of 
successive transformations. 


e) Match or draw congruent 
figures in a given collection. 


e) Justify relationships of congru- 
ence and similarity, and apply 
these relationships using scaling 
and proportional reasoning. 


e) Justify relationships of congru- 
ence and similarity, and apply 
these relationships using scaling 
and proportional reasoning. 




f) For similar figures, identify and 
use the relationships of conserva- 
tion of angle and of proportion- 
ality of side length and perimeter. 





continued on page 26 
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Geometry (continued) 



3) Relationships between geometric figures 


GRADE 4 


GRADES 


GRADE 12 


a) Analyze or describe patterns of 
geometric figures by increasing 
number of sides, changing size 
or orientation (e.g., polygons with 
more and more sides). 






b) Assemble simple plane shapes 
to construct a given shape. 


b) Apply geometric properties and 
relationships in solving simple 
problems in two and three 
dimensions. 


b) Apply geometric properties and 
relationships in solving multi- 
step problems in two and three 
dimensions (including rigid and 
nonrigid figures). 


c) Recognize two-dimensional 
faces of three-dimensional 
shapes. 


c) Represent problem situations 
with simple geometric models 
to solve mathematical or real- 
world problems. 


c) Represent problem situations 
with geometric models to solve 
mathematical or real-world 
problems. 




d) Use the Pythagorean theorem 
to solve problems. 


d) Use the Pythagorean theorem to 
solve problems in two- or three- 
dimensional situations. 






e) Describe and analyze properties 
of circles (e.g., perpendicularity 
of tangent and radius, angle in- 
scribed in a semicircle). 


f) Describe and compare properties 
of simple and compound figures 
composed of triangles, squares, 
and rectangles. 


f) Describe or analyze simple prop- 
erties of, or relationships between, 
triangles, quadrilaterals, and 
other polygonal plane figures. 


f) Analyze properties or relation- 
ships of triangles, quadrilaterals, 
and other polygonal plane 
figures. 




g) Describe or analyze properties 
and relationships of parallel or 
intersecting lines. 


g) Describe or analyze properties 
and relationships of parallel, per- 
pendicular, or intersecting lines, 
including the angle relationships 
that arise in these cases. 



continued on page 27 
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Geometry (continued) 



4) Position and direction 


GRADE 4 


GRADES 


GRADE 12 


a) Describe relative positions of 
points and lines using the geo- 
metric ideas of parallelism or 
perpendicularity. 


a) Describe relative positions of 
points and lines using the geo- 
metric ideas of midpoint, points 
on common line through a com- 
mon point, parallelism, or 
perpendicularity. 






b) Describe the intersection of 
two or more geometric figures 
in the plane (e.g., intersection 
of a circle and a line). 


b) Describe the intersections of 
lines in the plane and in space, 
intersections of a line and a 
plane, or of two planes in space. 




c) Visualize or describe the cross 
section of a solid. 


c) Describe or identify conic sec- 
tions and other cross sections 
of solids. 


d) Construct geometric figures 
with vertices at points on a 
coordinate grid. 


d) Represent geometric figures 
using rectangular coordinates 
on a plane. 


d) Represent two-dimensional 
figures algebraically using 
coordinates and/or equations. 






e) Use vectors to represent 
velocity and direction. 


5) Mathematical reasoning 


GRADE 4 


GRADES 


GRADE 12 


a) Distinguish which objects in 
a collection satisfy a given 
geometric definition and 
explain choices. 


a) Make and test a geometric 
conjecture about regular 
polygons. 


a) Make, test, and validate geo- 
metric conjectures using a 
variety of methods including 
deductive reasoning and 
counterexamples. 
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Data Analysis and Probability 

Data analysis covers the entire process of collecting, organizing, summarizing, and interpreting 
data. This is the heart of the discipline called statistics; it is in evidence whenever quantitative in- 
formation is used to determine a course of action. To emphasize the spirit of statistical thinking, 
data analysis should begin with a question to be answered, not with the data. Data should be col- 
lected only with a specific question (or questions) in mind and only after a plan (usually called a 
design) for collecting data relevant to the question is thought out. Beginning at an early age, stu- 
dents should grasp the fundamental principle that looking for questions in an existing data set is 
far different from the scientific method of collecting data to verify or refute a well-posed ques- 
tion. A pattern can be found in almost any data set if one looks hard enough, but a pattern discov- 
ered in this way is often meaningless, especially from the point of view of statistical inference. 

In the context of data analysis, or statistics, probability can be thought of as the study of po- 
tential patterns in outcomes that have not yet been observed. We say that the probability of a 
balanced coin coming up heads when flipped is one-half because we believe that about half of 
the flips would turn out to be heads if we flipped the coin many times. Under random sampling, 
patterns for outcomes of designed studies can be anticipated and used as the basis for making 
decisions. If the coin actually turned up heads 80 percent of the time, we would suspect that it 
was not balanced. The whole probability distribution of all possible outcomes is important in 
most statistics problems because the key to decisionmaking is to decide whether a particular ob- 
served outcome is unusual (located in a tail of the probability distribution). For example, 4 as a 
grade point average is unusually high among most groups of students, 4 as the pound weight of 
a baby is unusually low, and 4 as the number of runs scored in a baseball game is not unusual in 
either direction. 

By grade 4, students should be expected to apply their understanding of number and quantity 
to pose questions that can be answered by collecting appropriate data. They should be expected 
to organize data in a table or a plot and summarize the essential features of center, spread, and 
shape both verbally and with simple summary statistics. Simple comparisons can be made be- 
tween two related data sets, but more formal inference based on randomness should come later. 
The basic concept of chance and statistical reasoning can be built into meaningful contexts, 
though, such as, “If I draw two names from among those of the students in the room, am I likely 
to get two girls?” Such problems can be addressed through simulation. 

Building on the same definition of data analysis and the same principles of describing distri- 
butions of data through center, spread, and shape, grade 8 students will be expected to use a 
wider variety of organizing and summarizing techniques. They can also begin to analyze statisti- 
cal claims through designed surveys and experiments that involve randomization, with simula- 
tion being the main tool for making simple statistical inferences. They will begin to use more 
formal terminology related to probability and data analysis. 

Students in grade 12 will be expected to use a wide variety of statistical techniques for all 
phases of the data analysis process, including a more formal understanding of statistical inference 
(but still with simulation as the main inferential analysis tool). In addition to comparing univari- 
ate data sets, students at this level should be able to recognize and describe possible associations 
between two variables by looking at two-way tables for categorical variables or scatterplots for 
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measurement variables. Association between variables is related to the concepts of independence 
and dependence, and an understanding of these ideas requires knowledge of conditional probabil- 
ity. These students should be able to use statistical models (linear and nonlinear equations) to 
describe possible associations between measurement variables and should be familiar with tech- 
niques for fitting models to data. 



Data Analysis and Probability 



1) Data representation 


GRADE 4 


GRADES 


GRADE 12 


The following representations of data are indicated for each grade level. Objectives in which only a subset of 
these representations is applicable are indicated in the parenthesis associated with the objective. 


Pictographs, bar graphs, circle 
graphs, line graphs, line plots, 
tables, and tallies. 


Histograms, line graphs, scatter- 
plots, box plots, circle graphs, 
stem and leaf plots, frequency 
distributions, tables, and bar 
graphs. 


Histograms, line graphs, scatter- 
plots, box plots, circle graphs, 
stem and leaf plots, frequency 
distributions, and tables. 


a) Read or interpret a single set of 
data. 


a) Read or interpret data, including 
interpolating or extrapolating 
from data. 


a) Read or interpret data, including 
interpolating or extrapolating 
from data. 


b) For a given set of data, complete 
a graph (limits of time make it 
difficult to construct graphs 
completely). 


b) For a given set of data, complete 
a graph and then solve a problem 
using the data in the graph (his- 
tograms, line graphs, scatterplots, 
circle graphs, and bar graphs). 


b) For a given set of data, complete 
a graph and then solve a problem 
using the data in the graph (his- 
tograms, scatterplots, line 
graphs). 


c) Solve problems by estimating 
and computing within a single 
set of data. 


c) Solve problems by estimating and 
computing with data from a sin- 
gle set or across sets of data. 


c) Solve problems by estimating 
and computing with univariate 
or bivariate data (including scat- 
terplots and two-way tables). 




d) Given a graph or a set of data, 
determine whether information 
is represented effectively and 
appropriately (histograms, line 
graphs, scatterplots, circle 
graphs, and bar graphs). 


d) Given a graph or a set of data, 
determine whether information 
is represented effectively and 
appropriately (bar graphs, box 
plots, histograms, scatterplots, 
line graphs). 




e) Compare and contrast the effec- 
tiveness of different representa- 
tions of the same data. 


e) Compare and contrast the effec- 
tiveness of different representa- 
tions of the same data. 



continued on page 30 
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Data Analysis and Probability (continued) 



2) Characteristics of data sets 


GRADE 4 


GRADES 


GRADE 12 




a) Calculate, use, or interpret mean, 
median, mode, or range. 


a) Calculate, interpret, or use mean, 
median, mode, range, interquar- 
tile range, or standard deviation. 


b) Given a set of data or a graph, 
describe the distribution of the 
data using median, range, or 
mode. 


b) Describe how mean, median, 
mode, range, or interquartile 
ranges relate to the shape of 
the distribution. 


b) Recognize how linear transfor- 
mations of one-variable data af- 
fect mean, median, mode, and 
range (e.g., effect on the mean 
by adding a constant to each 
data point). 




c) Identify outliers and determine 
their effect on mean, median, 
mode, or range. 


c) Determine the effect of outliers 
on mean, median, mode, range, 
interquartile range, or standard 
deviation. 


d) Compare two sets of related 
data. 


d) Using appropriate statistical 
measures, compare two or more 
data sets describing the same 
characteristic for two different 
populations or subsets of the 
same population. 


d) Compare two or more data sets 
using mean, median, mode, 
range, interquartile range, or 
standard deviation describing 
the same characteristic for two 
different populations or subsets 
of the same population. 




e) Visually choose the line that 
best fits given a scatterplot and 
informally explain the meaning 
of the line. Use the line to make 
predictions. 


e) Given a set of data or a scatter- 
plot, visually choose the line of 
best fit and explain the meaning 
of the line. Use the line to make 
predictions. 






f) Use or interpret a normal distri- 
bution as a mathematical model 
appropriate for summarizing cer- 
tain sets of data. 






g) Given a scatterplot, make deci- 
sions or predictions involving a 
line or curve of best fit. 






h) Given a scatterplot, estimate 
the correlation coefficient (e.g.. 
Given a scatterplot, is the cor- 
relation closer to 0, .5, or 1.0? 
Is it a positive or negative 
correlation?). 



continued on page 31 
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Data Analysis and Probability (continued) 



3) Experiments and samples 


GRADE 4 


GRADES 


GRADE 12 




a) Given a sample, identify possible 
sources of bias in sampling. 


a) Identify possible sources of 
bias in data collection methods 
and describe how such bias can 
be controlled and reduced. 




b) Distinguish between a random 
and nonrandom sample. 


b) Recognize and describe a 
method to select a simple 
random sample. 






c) Make inferences from sample 
results. 




d) Evaluate the design of an 
experiment. 


d) Identify or evaluate the charac- 
teristics of a good survey or of 
a well-designed experiment. 


4) Probability 


GRADE 4 


GRADES 


GRADE 12 


a) Use informal probabilistic think- 
ing to describe chance events 
(i.e., likely and unlikely, certain 
and impossible). 


a) Analyze a situation that involves 
probability of an independent 
event. 


a) Analyze a situation that involves 
probability of independent or 
dependent events. 


b) Determine a simple probability 
from a context that includes a 
picture. 


b) Determine the theoretical proba- 
bility of simple and compound 
events in familiar contexts. 


b) Determine the theoretical proba- 
bility of simple and compound 
events in familiar or unfamiliar 
contexts. 




c) Estimate the probability of 
simple and compound events 
through experimentation or 
simulation. 


c) Given the results of an experi- 
ment or simulation, estimate 
the probability of simple or 
compound events in familiar or 
unfamiliar contexts. 




d) Use theoretical probability to 
evaluate or predict experimental 
outcomes. 


d) Use theoretical probability to 
evaluate or predict experimental 
outcomes. 


e) List all possible outcomes of a 
given situation or event. 


e) Determine the sample space 
for a given situation. 


e) Determine the number of ways 
an event can occur using tree 
diagrams, formulas for combina- 
tions and permutations, or other 
counting techniques. 




f) Use a sample space to determine 
the probability of the possible 
outcomes of an event. 


f) Determine the probability of the 
possible outcomes of an event. 


g) Represent the probability of a 
given outcome using a picture 
or other graphic. 


g) Represent probability of a given 
outcome using fractions, deci- 
mals, and percents. 





continued on page 32 
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Data Analysis and Probability (continued) 



4) Probability (continued) 


GRADE 4 


GRADES 


GRADE 12 




h) Determine the probability of in- 
dependent and dependent events. 
(Dependent events should be 
limited to linear functions with 
a small sample size.) 


h) Determine the probability of in- 
dependent and dependent events. 






i) Determine conditional probabil- 
ity using two-way tables. 




j) Interpret probabilities within a 
given context. 


j) Interpret probabilities within a 
given context. 



Algebra 

Algebra was pioneered in the Middle Ages by mathematicians in the Middle East and Asia as 
a method of solving equations easily and efficiently by manipulation of symbols, rather than by 
the earlier geometric methods of the Greeks. The two approaches were eventually united in the 
analytic geometry of Rene Descartes. Modern symbolic notation, developed in the Renaissance, 
greatly enhanced the power of the algebraic method; from the 17th century forward, algebra in 
turn promoted advances in all branches of mathematics and science. 

The widening use of algebra led to the study of its formal structure. Out of this were gradual- 
ly distilled the “rules of algebra,” a compact summary of the principles behind algebraic manip- 
ulation. A parallel line of thought produced a simple but flexible concept of function and also 
led to the development of set theory as a comprehensive background for mathematics. When it 
is taken liberally to include these ideas, algebra reaches from the foundations of mathematics to 
the frontiers of current research. 

These two aspects of algebra, a powerful representational tool and a vehicle for comprehensive 
concepts such as function, form the basis for the expectations throughout the grades. By grade 
4, students are expected to be able to recognize and extend simple numeric patterns as one foun- 
dation for a later understanding of function. They can begin to understand the meaning of equal- 
ity and some of its properties, as well as the idea of an unknown quantity as a precursor to the 
concept of variable. 

As students move into middle school, the ideas of function and variable become more important. 
Representation of functions as patterns, via tables, verbal descriptions, symbolic descriptions, and 
graphs, can combine to promote a flexible grasp of the idea of function. Linear functions receive 
special attention. They connect to the ideas of proportionality and rate, forming a bridge that 
will eventually link arithmetic to calculus. Symbolic manipulation in the relatively simple con- 
text of linear equations is reinforced by other means of finding solutions, including graphing by 
hand or with calculators. 

In high school, students should become comfortable in manipulating and interpreting more 
complex expressions. The rules of algebra should come to be appreciated as a basis for reasoning. 
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Nonlinear functions, especially quadratic functions, and also power and exponential functions, 
are introduced to solve real-world problems. Students should become accomplished at translating 
verbal descriptions of problem situations into symbolic form. Expressions involving several vari- 
ables, systems of linear equations, and the solutions to inequalities are encountered by grade 12. 



Algebra 



1) Patterns, relations, and functions 


GRADE 4 


GRADES 


GRADE 12 


a) Recognize, describe, or extend 
numerical patterns. 


a) Recognize, describe, or extend 
numerical and geometric patterns 
using tables, graphs, words, or 
symbols. 


a) Recognize, describe, or extend 
arithmetic, geometric progres- 
sions, or patterns using words or 
symbols. 


b) Given a pattern or sequence, 
construct or explain a rule that 
can generate the terms of the 
pattern or sequence. 


b) Generalize a pattern appearing in 
a numerical sequence or table or 
graph using words or symbols. 


b) Express the function in general 
terms (either recursively or ex- 
plicitly), given a table, verbal 
description, or some terms of a 
sequence. 


c) Given a description, extend or 
find a missing term in a pattern 
or sequence. 


c) Analyze or create patterns, 
sequences, or linear functions 
given a rule. 




d) Create a different representation 
of a pattern or sequence given a 
verbal description. 






e) Recognize or describe a relation- 
ship in which quantities change 
proportionally. 


e) Identify functions as linear or 
nonlinear or contrast distinguish- 
ing properties of functions from 
tables, graphs, or equations. 


e) Identify or analyze distinguishing 
properties of linear, quadratic, 
inverse (y = k/v) or exponential 
functions from tables, graphs, or 
equations. 




f) Interpret the meaning of slope or 
intercepts in linear functions. 








g) Determine the domain and 
range of functions given various 
contexts. 






h) Recognize and analyze the gener- 
al forms of linear, quadratic, in- 
verse, or exponential functions 
(e.g., in y = av + b, recognize 
the roles of a and b). 






i) Express linear and exponential 
functions in recursive and ex- 
plicit form given a table or 
verbal description. 



continued on page 34 
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Algebra (continued) 



2) Algebraic representations 


GRADE 4 


GRADES 


GRADE 12 


a) Translate between the different 
forms of representations (sym- 
bolic, numerical, verbal, or 
pictorial) of whole number re- 
lationships (such as from a writ- 
ten description to an equation 
or from a function table to a 
written description). 


a) Translate between different rep- 
resentations of linear expressions 
using symbols, graphs, tables, di- 
agrams, or written descriptions. 


a) Translate between different rep- 
resentations of algebraic expres- 
sions using symbols, graphs, 
tables, diagrams, or written 
descriptions. 




b) Analyze or interpret linear rela- 
tionships expressed in symbols, 
graphs, tables, diagrams, or writ- 
ten descriptions. 


b) Analyze or interpret relationships 
expressed in symbols, graphs, 
tables, diagrams, or written 
descriptions. 


c) Graph or interpret points with 
whole number or letter coordi- 
nates on grids or in the first 
quadrant of the coordinate plane. 


c) Graph or interpret points that are 
represented by ordered pairs of 
numbers on a rectangular coordi- 
nate system. 


c) Graph or interpret points that are 
represented by one or more or- 
dered pairs of numbers on a rec- 
tangular coordinate system. 




d) Solve problems involving coor- 
dinate pairs on the rectangular 
coordinate system. 


d) Perform or interpret transforma- 
tions on the graphs of linear and 
quadratic functions. 


e) Verify a conclusion using alge- 
braic properties. 


e) Make, validate, and justify con- 
clusions and generalizations 
about linear relationships. 


e) Use algebraic properties to 
develop a valid mathematical 
argument. 






f) Use an algebraic model of a 
situation to make inferences or 
predictions. 




g) Identify or represent functional 
relationships in meaningful con- 
texts including proportional, 
linear, and common nonlinear 
(e.g., compound interest, bacte- 
rial growth) in tables, graphs, 
words, or symbols. 


g) Given a real-world situation, 
determine if a linear, quadratic, 
inverse, or exponential function 
fits the situation (e.g., half-life 
bacterial growth). 






h) Solve problems involving expo- 
nential growth and decay. 



continued on page 35 
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Algebra (continued) 



3) Variables, expressions, and operations 


GRADE 4 


GRADES 


GRADE 12 


a) Use letters and symbols to repre- 
sent an unknown quantity in a 
simple mathematical expression. 






b) Express simple mathematical 
relationships using number 
sentences. 


b) Write algebraic expressions, 
equations, or inequalities to 
represent a situation. 


b) Write algebraic expressions, 
equations, or inequalities to 
represent a situation. 




c) Perform basic operations, using 
appropriate tools, on linear alge- 
braic expressions (including 
grouping and order of multiple 
operations involving basic 
operations, exponents, roots, 
simplifying, and expanding). 


c) Perform basic operations, using 
appropriate tools, on algebraic 
expressions (including grouping 
and order of multiple operations 
involving basic operations, ex- 
ponents, roots, simplifying, and 
expanding). 






d) Write equivalent forms of alge- 
braic expressions, equations, or 
inequalities to represent and ex- 
plain mathematical relationships. 



continued on page 36 
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Algebra (continued) 



4) Equations and inequalities 


GRADE 4 


GRADES 


GRADE 12 


a) Find the value of the unknown in 
a whole number sentence. 


a) Solve linear equations or inequal- 
ities (e.g., aXH-b = coratC-i-b = 
cx H- d or ax H- b > c). 


a) Solve linear, rational, or quad- 
ratic equations or inequalities. 




b) Interpret "=" as an equivalence 
between two expressions and 
use this interpretation to solve 
problems. 






c) Analyze situations or solve 
problems using linear equations 
and inequalities with rational 
coefficients symbolically or 
graphically (e.g., aX H- b = c or 
ax H- b = cx -H d). 


c) Analyze situations or solve prob- 
lems using linear or quadratic 
equations or inequalities sym- 
bolically or graphically. 




d) Interpret relationships between 
symbolic linear expressions and 
graphs of lines by identifying 
and computing slope and inter- 
cepts (e.g., know in y = ax + b, 
that a is the rate of change and 
b is the vertical intercept of the 
graph). 


d) Recognize the relationship be- 
tween the solution of a system 
of linear equations and its graph. 




e) Use and evaluate common for- 
mulas [e.g., relationship between 
a circle’s circumference and di- 
ameter (C = Trd), distance and 
time under constant speed] . 


e) Solve problems involving more 
advanced formulas [e.g., the vol- 
umes and surface areas of three 
dimensional solids; or such for- 
mulas as: A = P(1 + r)*, A = Pe"]. 






f) Given a familiar formula, solve 
for one of the variables. 






g) Solve or interpret systems of 
equations or inequalities. 



36 






Chapter Four: Mathematical Complexity 
of Items 



E ach NAEP item assesses an objective that can be associated with a single content area of 
mathematics, such as number or geometry. The item also makes certain demands on stu- 
dents’ thinking. These demands constitute the mathematical complexity of the item, which 
is the second dimension of the mathematics framework. The demands on thinking that an item 
makes (what it asks the student to recall, understand, reason about, and do) are determined on 
the assumption that the student is familiar with the mathematics of the task. If a student has not 
studied the mathematics, the task is likely to make different and heavier demands, and the stu- 
dent may well not be successful. Items are chosen for administration at a given grade level in 
part on the basis of their appropriateness for typical curricula, but the complexity of those items 
is always independent of the particular curriculum a student has experienced. 

The categories (low complexity, moderate complexity, and high complexity) form an ordered 
description of the demands an item may make on a student. Items at the low level of complexity, 
for example, may ask a student to recall a property. At the moderate level, an item may ask the 
student to make a connection between two properties; at the high level, an item may ask a student 
to analyze the assumptions made in a mathematical model. This is an example of the distinctions 
made in item complexity to provide balance in the item pool. The ordering is not intended to 
imply that mathematics is learned or should be taught in such an ordered way. 

The complexity dimension is both similar to and different from the levels of mathematical 
ability (conceptual understanding, procedural knowledge, and problemsolving) that were used 
in the NAEP Mathematics Eramework for the 1996 and 2000 assessments. The dimensions are 
similar in that both attempt to address the kind of thinking that the student is doing when work- 
ing on an item. They are also similar in that although neither dimension is used to define specif- 
ic percentages of items in each content area, both are used to help define item descriptors and to 
achieve a balance across the tasks administered at each grade level. Eevel of complexity is dif- 
ferent from level of mathematical ability, however, in that complexity describes the mathemati- 
cal expectations of an item, whereas mathematical ability (along with the associated construct of 
mathematical power) requires an inference about the skill, knowledge, and background of the 
students taking the item. 

The mathematical complexity of an item is not directly related to its format (multiple choice, 
short constructed response, or extended constructed response). Items requiring that the student 
generate a response tend to make somewhat heavier demands on students than items requiring 
a choice among alternatives, but that is not always the case. Any type of item can deal with 
mathematics of greater or lesser depth and sophistication. There are multiple-choice items that 
assess complex mathematics, and constructed-response items can be crafted to assess routine 
mathematical ideas. Moreover, the mathematical complexity of an item is constant; it does not 
vary depending on the score given for a certain kind or level of response. 
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Low Complexity 

This category relies heavily on the recall and recognition of previously learned concepts and 
principles. Items typically specify what the student is to do, which is often to carry out some 
procedure that can be performed mechanieally. It is not left to the student to eome up with an 
original method or solution. The following are some, but not all, of the demands that items in 
the low-complexity category might make: 

• Recall or recognize a fact, term, or property. 

• Recognize an example of a concept. 

• Compute a sum, difference, product, or quotient. 

• Recognize an equivalent representation. 

• Perform a specified procedure. 

• Evaluate an expression in an equation or formula for a given variable. 

• Solve a one-step word problem. 

• Draw or measure simple geometric figures. 

• Retrieve information from a graph, table, or figure. 

Examples 

See appendix B for solutions and scoring guides 

• Recall or recognize a fact, term, or property. 

How many fourths make a whole? 

Answer: 

Source: 1996 NAEP (grade 4) Percent correct: 50 



• Recall or recognize a fact, term, or property. 

Which of the following is NOT a property of every rectangle? 

A. The opposite sides are equal in length. 

B. The opposite sides are parallel. 

C. All angles are equal in measure. 

D. All sides are equal in length. 

E. The diagonals are equal in length. 

Source: 1992 NAEP (grade 12) Percent correct: 71 
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• Compute a sum, difference, product, or quotient. 

What is 2/3 of 15 marbles? 

A. 10 marbles 

B. 9 marbles 

C. 8 marbles 

D. 5 marbles 

Source: 1990 NAEP (grade 12) Percent correct: 74 



• Compute a sum, difference, product, or quotient. 

+ 6+12 = 

A. -6 

B. +6 

C. -18 

D. +18 

Source: 1990 NAEP (grade 8) Percent correct: 68 



• Provide or recognize equivalent representations. 

N stands for the number of stamps John had. He gave 12 stamps to his sister. 
Which expression tells how many stamps John has now? 

A. A+ 12 

B. N- 12 



C. 12- N 

D. 12xN 

Source: 1996 NAEP (grade 4) Percent correct: 67 
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• Perform a specified procedure. 

How many hours are equal to 150 minutes? 

A. VA 

B. 2A 

C. 2A 

D. 2A 

E. 2% 

Source: 1990 NAEP (grade 12) Percent correct: 74 



• Retrieve information from a graph, table, or figure. 




What is the weight shown on the scale? 

A. 6 pounds 

B. 7 pounds 

C. 51 pounds 

D. 60 pounds 

Source: 1992 NAEP (grade 4) Percent correct: 44 



Moderate Complexity 

Items in the moderate-complexity category involve more flexibility of thinking and choice 
among alternatives than do those in the low -complexity category. They require a response that 
goes beyond the habitual, is not specified, and ordinarily has more than a single step. The stu- 
dent is expected to decide what to do, using informal methods of reasoning and problemsolving 
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strategies, and to bring together skill and knowledge from various domains. The following illus- 
trate some of the demands that items of moderate complexity might make: 

• Represent a situation mathematically in more than one way. 

• Select and use different representations, depending on situation and purpose. 

• Solve a word problem requiring multiple steps. 

• Compare figures or statements. 

• Provide a justification for steps in a solution process. 

• Interpret a visual representation. 

• Extend a pattern. 

• Retrieve information from a graph, table, or figure and use it to solve a problem requiring 
multiple steps. 

• Formulate a routine problem, given data and conditions. 

• Interpret a simple argument. 

Examples 

See appendix B for solutions and scoring guides 

The following shapes were provided to students. (Shapes were larger than shown.) 



N 



(Grade 8 version) 

Bob, Carmen, and Tyler were comparing the areas of N and P. Bob said that N and P have 
the same area. Carmen said that the area of N is larger. Tyler said that the area of P is larger. 

Who was correct? 

Use words or pictures (or both) to explain why. 

Source: 1996 NAEP (grades 4 and 8) Percent correct: 27 
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Interpret a visual representation. 




In this figure, how many small cubes were put together to form the large cube? 

A. 7 

B. 8 

C. 12 

D. 24 

Source: 1996 NAEP (grade 4) Percent correct: 33 



• Extend a pattern. 

Erom any vertex of a 4-sided polygon, 1 diagonal can be drawn. 

Erom any vertex of a 5-sided polygon, 2 diagonals can be drawn. 

Erom any vertex of a 6-sided polygon, 3 diagonals can be drawn. 

Erom any vertex of a 7-sided polygon, 4 diagonals can be drawn. 

How many diagonals can be drawn from any vertex of a 20-sided polygon? 

Answer: 

Source: 1996 NAEP (grade 8) Percent correct: 54 



• Interpret a simple argument. 

Tracy said, “I can multiply 6 by another number and get an answer that is smaller than 6.” 

Pat said, “No, you can’t. Multiplying 6 by another number always makes the answer 6 or 
larger.” 

Who is correct? Give a reason for your answer. 

Source: 1992 NAEP (grades 8 and 12) Percent correct: 49 (grade 8); 63 (grade 12) 
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High Complexity 

High-complexity items make heavy demands on students, who must engage in more abstract 
reasoning, planning, analysis, judgment, and creative thought. A satisfactory response to the 
item requires that the student think in abstract and sophisticated ways. Items at the level of high 
complexity may ask the student to do any of the following: 

• Describe how different representations can be used for different purposes. 

• Perform a procedure having multiple steps and multiple decision points. 

• Analyze similarities and differences between procedures and concepts. 

• Generalize a pattern. 

• Formulate an original problem, given a situation. 

• Solve a novel problem. 

• Solve a problem in more than one way. 

• Explain and justify a solution to a problem. 

• Describe, compare, and contrast solution methods. 

• Formulate a mathematical model for a complex situation. 

• Analyze the assumptions made in a mathematical model. 

• Analyze or produce a deductive argument. 

• Provide a mathematical justification. 

Examples 

See appendix B for solutions and scoring guides 

• Generalize a pattern. 

A pattern of dots is shown below. At each step, more dots are added to the pattern. The 
number of dots added at each step is more than the number added in the previous step. 
The pattern continues infinitely. 



(1st step) 



• • 

2 Dots 



(2nd step) 

• • • 
• • • 

6 Dots 



(3rd step) 

• • • • 
• • • • 
• • • • 

12 Dots 



Marcy has to determine the number of dots in the 20th step, but she does not want to 
draw all 20 pictures and then count the dots. Explain or show how she could do this and 
give the answer that Marcy should get for the number of dots. 

Source: 1992 NAEP (grade 8) Percent correct: 6 
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Analyze or produce a deductive argument. 

Jaime knows the following facts about points A, B, and C. 



• Points A, B, and C are on the same line, but might not be in that order. 

• Point C is twice as far from point A as it is from point B. 

Jaime concluded that point C is always between points A and B. 

Is Jaime’s conclusion correct? 

CD Yes CD No 

In the space provided, use a diagram to explain your answer. 

Source: 1996 NAEP (grade 8) Percent correct: 23 



• Provide a mathematical justification 




In Mr. Bell’s classes, the students voted for their favorite shape for a symbol. 
Here are the results. 





Class 1 


Class 2 


Class 3 


Shape N 


9 


14 


11 


Shape P 


1 


9 


17 


Shape Q 


22 


7 


2 



Using the information in the chart, Mr. Bell must select one of the shapes to be the sym- 
bol. Which one should he select and why? 

The shape Mr. Bell should select: 

Explain. 

Source: 1996 NAEP (grades 4 and 8) Percent correct: 31 (grade 4); 58 (grade 8) 
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Balance of Mathematical Complexity 

The ideal balance sought for the 2005 NAEP is not necessarily the balance one would wish 
for curriculum or instruction in mathematics education. Balance here must be considered in the 
context of the constraints of an assessment such as NAEP. These constraints include the timed 
nature of the test and its paper- and-pencil format. Items of high complexity, for example, often 
take more time to complete. At the same time, some items of all three types are essential to as- 
sess the full range of students’ mathematical achievement. Within that context, the ideal balance 
would be that half of the score on the assessment is based on items of moderate complexity, 
with the remainder of the score based equally on items of low and high complexity. This bal- 
ance would apply for all three grade levels. 
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Chapter Five: Item Formats 



C entral to the development of the NAEP assessment in mathematics is the careful selec- 
tion of items/tasks. Since the 1992 assessment, items have consisted of three formats: 
multiple choice, short constructed response, and extended constructed response. Testing 
time on NAEP is divided evenly between multiple-choice items and both types of constructed- 
response items, as shown below: 



Multiple 

Choice 




Constructed 

Response 



Amount of TIME spent on Item Formats 



Multiple- Choice Items 

Multiple-choice items require students to read, reflect, or compute, and then to select the al- 
ternative that best expresses what they believe the answer to be. This format is appropriate for 
quickly determining whether students have achieved certain knowledge and skills. A carefully 
constructed multiple-choice item can assess any of the levels of mathematical complexity (de- 
scribed in chapter 4), from simple procedures to more sophisticated concepts. Such items are 
limited in the extent to which they can provide evidence of the depth of students’ thinking. 

Example 




In the graph above, each dot shows the number of sit-ups and the corresponding age for 
1 of 13 people. According to this graph, what is the median number of sit-ups for these 
13 people? 
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A. 15 

B. 20 

C. 45 

D. 50 

E. 55 



This item assesses students’ understanding of two concepts: median, and how data are dis- 
played on a graph. For students who are able to combine these concepts, little or no computation 
is required to determine the correct answer (D). 

Short Constructed-Response Items 

To provide more reliable and valid opportunities for extrapolating about students’ approaches 
to problems, NAEP assessments have included items that are often referred to as short constructed- 
response items. These are short-answer items that require students to give either a numerical re- 
sult or the correct name or classification for a group of mathematical objects, draw an example 
of a given concept, or perhaps write a brief explanation for a given result. 

Example 

Product 

2x2=4 
2x2x2 =8 
2x2x2x2 =16 
2x2x2x2x2 =32 

If the pattern shown continues, could 375 be one of the products in this pattern? 

Explain why or why not. 



48 




Scoring Guide 

Score and Description 
1 - Correct 

Correct reason: 

“Because 375 is not divisible by 2 (or is not even)” 

OR 

“Because 375 is between two of the numbers in the pattern.” 
Acceptable: “Because 375 is uneven.” 

Not acceptable: 

“Because you’re counting by 2s.” 

OR 

“Because you’re multiplying by 2.” 

0 - Incorrect 

Any incorrect or incomplete reason. 



This item assesses students’ understanding of number patterns and of odd and even numbers. 
Students are given the opportunity to explain why 375 could not be one of the products in the 
pattern. Scoring for this item was done on a correct/incorrect basis. Items such as this are valu- 
able in providing greater evidence of the depth of students’ understanding than might be accom- 
plished in other formats. Scoring for some short constructed-response items uses more than two 
points in the scale to award partial credit for work that is partially correct. Full credit is reserved 
for work that is mathematically correct and complete. 

Extended Constructed-Response Items 

Extended constructed-response items require students to consider a situation that demands 
more than a numerical response or a short verbal communication. If it is a problem to solve, the 
student is asked to carefully consider a situation within or across content areas, understand what 
is required to “solve” the situation, choose a plan of attack, carry out the attack, and interpret 
the solution derived in terms of the original situation. In the example that follows, the student is 
asked to analyze a situation and provide a mathematical explanation. 
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Example 

In a game, Carla and Maria are making subtraction problems using tiles numbered 1 to 5. 
The player whose subtraction problem gives the largest answer wins the game. 

Look at where each girl placed two of her tiles. 



Carla Maria 







5 


— 




1 



1 






— 


5 






Explain how you know this person will win. 



In this item, students are given the opportunity to display their understanding of place value 
and subtraction. They must examine the numbers left on each player’s tiles, consider all the pos- 
sible placements of those tiles in the remaining spaces, then compare the results of the subtrac- 
tion and construct an explanation of the situation. 

Scoring Extended Constructed-Response Items 

Extended constructed-response items in mathematics should be evaluated according to an es- 
tablished grading scale developed from a sample of actual student responses. The scale used 
should follow a multiple-point format similar to the following (this is the scoring guide for the 
previous example item): 
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Scoring Guide 



Solution: 

Maria will win the game. 

The following reasons may be given: 

a. The largest possible difference for Carla is less than 100 and the smallest possible 
difference for Maria is 194. 

b. Carla will only get a difference of 91 or less but Maria will get several larger differences. 

c. Carla can have only up to 143 as her top number, but Maria can have 435 as her 
largest number. 

d. Carla has only 1 hundred but Maria can have 2, 3, or 4 hundreds. 

e. Maria can never take away as much as Carla. 

f. Any combination of problems to show that Maria’s difference is greater. 



Carla 



1 


4 


3 


— 


5 


2 



Maria 



3 


4 


5 


— 


2 


1 
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Score and Description 
4 - Extended 

Student answers Maria and gives explanation such as (a) or (b), or an appropriate combina- 
tion of the other explanations. 

3 - Satisfactory 

Student answers Maria and gives explanation such as (c), (d), or (e). 

2 - Partial 

Student answers Maria with partially correct, or incomplete but relevant, explanation. 

1 - Minimal 

Student answers Maria and gives example such as in (f) but no explanation OR answers 
Maria with an incorrect explanation. 

0 - Incorrect 

Incorrect response 



A scoring scale adapted to a particular problem and applied by experienced scorers provides 
rich information about students’ understanding of concepts and procedures, and about their abil- 
ity to solve a problem and communicate understanding of the process. 
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Appendix A 

NAEP Mathematics Achievement Level Descriptions 




Grade 4 
Basic 



Proficient 



Advanced 



Grade 8 
Basic 



Fourth-grade students performing at the Basic level should show some evi- 
dence of understanding the mathematical concepts and procedures in the five 
NAEP content areas. 

Fourth graders performing at the Basic level should be able to estimate and use 
basic facts to perform simple computations with whole numbers; show some un- 
derstanding of fractions and decimals; and solve some simple real-world problems 
in all NAEP content areas. Students at this level should be able to use — though not 
always accurately — four-function calculators, rulers, and geometric shapes. Their 
written responses are often minimal and presented without supporting information. 

Fourth-grade students performing at the Proficient level should consistently 
apply integrated procedural knowledge and conceptual understanding to 
problem solving in the five NAEP content areas. 

Fourth graders performing at the Proficient level should be able to use whole num- 
bers to estimate, compute, and determine whether results are reasonable. They 
should have a conceptual understanding of fractions and decimals; be able to solve 
real-world problems in all NAEP content areas; and use four-function calculators, 
rulers, and geometric shapes appropriately. Students performing at the Proficient 
level should employ problem-solving strategies such as identifying and using ap- 
propriate information. Their written solutions should be organized and presented 
both with supporting information and explanations of how they were achieved. 

Fourth-grade students performing at the Advanced level should apply inte- 
grated procedural knowledge and conceptual understanding to complex and 
nonroutine real-world problem solving in the five NAEP content areas. 

Fourth graders performing at the Advanced level should be able to solve complex 
nonroutine real-world problems in all NAEP content areas. They should display 
mastery in the use of four- function calculators, rulers, and geometric shapes. These 
students are expected to draw logical conclusions and justify answers and solution 
processes by explaining why, as well as how, they were achieved. They should go 
beyond the obvious in their interpretations and be able to communicate their 
thoughts clearly and concisely. 



Eighth-grade students performing at the Basic level should exhibit evidence 
of conceptual and procedural understanding in the five NAEP content areas. 
This level of performance signifies an understanding of arithmetic operations — 
including estimation — on whole numbers, decimals, fractions, and percents. 

Eighth graders performing at the Basic level should complete problems correctly 
with the help of structural prompts such as diagrams, charts, and graphs. They 
should be able to solve problems in all NAEP content areas through the appropriate 
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Proficient 



Advanced 



Grade 12 
Basic 



selection and use of strategies and technological tools, including calculators, com- 
puters, and geometric shapes. Students at this level also should be able to use fun- 
damental algebraic and informal geometric concepts in problem solving. As they 
approach the Proficient level, students at the Basic level should be able to deter- 
mine which of the available data are necessary and sufficient for correct solutions 
and use them in problem solving. However, these eighth graders show limited skill 
in communicating mathematically. 

Eighth-grade students performing at the Proficient level should apply mathe- 
matical concepts and procedures consistently to complex problems in the five 
NAEP content areas. 

Eighth graders performing at the Proficient level should be able to conjecture, de- 
fend their ideas, and give supporting examples. They should understand the con- 
nections among fractions, percents, decimals, and other mathematical topics such 
as algebra and functions. Students at this level are expected to have a thorough un- 
derstanding of Basic level arithmetic operations — an understanding sufficient for 
problem solving in practical situations. Quantity and spatial relationships in prob- 
lem solving and reasoning should be familiar to them, and they should be able to 
convey underlying reasoning skills beyond the level of arithmetic. They should be 
able to compare and contrast mathematical ideas and generate their own examples. 
These students should make inferences from data and graphs, apply properties of 
informal geometry, and accurately use the tools of technology. Students at this 
level should understand the process of gathering and organizing data and be able 
to calculate, evaluate, and communicate results within the domain of statistics and 
probability. 

Eighth-grade students performing at the Advanced level should be able to 
reach beyond the recognition, identification, and application of mathematical 
rules in order to generalize and synthesize concepts and principles in the five 
NAEP content areas. 

Eighth graders performing at the Advanced level should be able to probe examples 
and counterexamples in order to shape generalizations from which they can devel- 
op models. Eighth graders performing at the Advanced level should use number 
sense and geometric awareness to consider the reasonableness of an answer. They 
are expected to use abstract thinking to create unique problem-solving techniques 
and explain the reasoning processes underlying their conclusions. 



Twelfth- grade students performing at the Basic level should demonstrate pro- 
cedural and conceptual knowledge in solving problems in the five NAEP con- 
tent areas. 

Twelfth graders performing at the Basic level should be able to use estimation to 
verify solutions and determine the reasonableness of results as applied to real-world 
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Proficient 



Advanced 



problems. They are expected to use algebraic and geometric reasoning strategies to 
solve problems. Twelfth graders performing at the Basic level should recognize 
relationships presented in verbal, algebraic, tabular, and graphical forms; and 
demonstrate knowledge of geometric relationships and corresponding measure- 
ment skills. They should be able to apply statistical reasoning in the organization 
and display of data and in reading tables and graphs. They also should be able to 
generalize from patterns and examples in the areas of algebra, geometry, and sta- 
tistics. At this level, they should use correct mathematical language and symbols 
to communicate mathematical relationships and reasoning processes, and use cal- 
culators appropriately to solve problems. 

Twelfth-grade students performing at the Proficient level should consistently 
integrate mathematical concepts and procedures into the solutions of more 
complex problems in the five NAEP content areas. 

Twelfth graders performing at the Proficient level should demonstrate an under- 
standing of algebraic, statistical, and geometric and spatial reasoning. They should 
be able to perform algebraic operations involving polynomials, justify geometric 
relationships, and judge and defend the reasonableness of answers as applied to 
real-world situations. These students should be able to analyze and interpret data 
in tabular and graphical form; understand and use elements of the function concept 
in symbolic, graphical, and tabular form; and make conjectures, defend ideas, and 
give supporting examples. 

Twelfth-grade students performing at the Advanced level should consistently 
demonstrate the integration of procedural and conceptual knowledge and the 
synthesis of ideas in the five NAEP content areas. 

Twelfth-grade students performing at the Advanced level should understand the 
function concept and be able to compare and apply the numeric, algebraic, and 
graphical properties of functions. They should apply their knowledge of algebra, 
geometry, and statistics to solve problems in more Advanced areas of continuous 
and discrete mathematics. They should be able to formulate generalizations and 
create models through probing examples and counterexamples. They should be 
able to communicate their mathematical reasoning through the clear, concise, and 
correct use of mathematical symbolism and logical thinking. 
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Appendix B 

Mathematical Complexity Items Scoring Guide 




Low Complexity 

How many fourths make a whole? 

Answer: 

Source: 1996 NAEP (grade 4) Percent correct: 50 

Scoring Guide 

Scoring Rubric 
1 - Correct 

4, 4 fourths, etc. 

0 - Incorrect 

Any incorrect response 



Which of the following is NOT a property of every rectangle? 

A. The opposite sides are equal in length. 

B. The opposite sides are parallel. 

C. All angles are equal in measure. 

*D. All sides are equal in length. 

E. The diagonals are equal in length. 

Source: 1992 NAEP (grade 12) Percent correct: 71 



What is 2/3 of 15 marbles? 

*A. 10 marbles 

B. 9 marbles 

C. 8 marbles 

D. 5 marbles 

Source: 1990 NAEP (grade 12) Percent correct: 74 

( Students did not have access to a calculator. ) 
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Percent correct: 68 



+ 6 + -12 = 

*A. -6 

B. +6 

C. -18 

D. +18 

Source: 1990 NAEP (grade 8) 



N stands for the number of stamps John had. He gave 12 stamps to his sister. 
Which expression tells how many stamps John has now? 

A. N+ 12 

*B. N- 12 

C. 12-N 



D. 12 X A 

Source: 1996 NAEP (grade 4) Percent correct: 67 



How many hours are equal to 150 minutes? 

A. VA 

B. 2A 

C. 2A 
*D. 2A 

E. 2% 

Source: 1990 NAEP (grade 12) Percent correct: 74 
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0 



250 






Pounds 


200 


100 




150 ; 



What is the weight shown on the scale? 

A. 6 pounds 

B. 7 pounds 

C. 51 pounds 
*D. 60 pounds 

Source: 1992 NAEP (grade 4) Percent correct: 44 



Moderate Complexity 

The following shapes were provided to students. (Shapes were larger than shown.) 



N 



(Grade 8 version) 

Bob, Carmen, and Tyler were comparing the areas of N and P. Bob said that N and P have 
the same area. Carmen said that the area of N is larger. Tyler said that the area of P is larger. 

Who was correct? 

Use words or pictures (or both) to explain why. 

Source: 1996 NAEP (grade 8) Percent correct: 27 
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Scoring Rubric (continued) 

1 - Correct 

Correct response (see page 66). 

0 - Incorrect 

Bob was correct, but explanation not given or inadequate Any response that answers Carmen 
or Tyler to “Who was correct?” or omits the name and gives no satisfactory explanation. 




In this figure, how many small cubes were put together to form the large cube? 
A. 7 
*B. 8 

C. 12 

D. 24 

Source: 1996 NAEP (grade 4) Percent correct: 33 



From any vertex of a 4-sided polygon, 1 diagonal can be drawn. 

From any vertex of a 5-sided polygon, 2 diagonals can be drawn. 

From any vertex of a 6-sided polygon, 3 diagonals can be drawn. 

From any vertex of a 7-sided polygon, 4 diagonals can be drawn. 

How many diagonals can be drawn from any vertex of a 20-sided polygon? 

Answer: 

Source: 1996 NAEP (grade 8) Percent correct: 54 
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Scoring Guide 



Scoring Rubric 



1 - Correct 

17 

Number of diagonals is always 3 less than the number of sides. 



0 - Incorrect 

Any incorrect response. 



Tracy said, “I can multiply 6 by another number and get an answer that is smaller than 6.” 

Pat said, “No, you can’t. Multiplying 6 by another number always makes the answer 6 or 
larger.” 

Who is correct? Give a reason for your answer. 

Source: 1992 NAEP (grades 8 and 12) Percent correct: 49 (grade 8); 63 (grade 12) 

Scoring Guide 

Scoring Rubric 
1 - Correct 

Tracy, with correct answer given. 

OR 

No name stated but reason given is correct. 

Examples of correct reasons: 

• If you multiply by a number smaller than 1 the result is less than 6. 

•6x0 = 0 

• 6 X 1/2 = 3 

• 6 X -1 = -6 

0 - Incorrect 

Tracy with no reason. 

OR 

Any response that states Pat is correct. 

OR 

No name stated and reason given is incorrect. 



68 







High Complexity 

A pattern of dots is shown below. At each step, more dots are added to the pattern. The 
number of dots added at each step is more than the number added in the previous step. 
The pattern continues infinitely. 



(1st step) 



2 Dots 



(2nd step) 




6 Dots 



(3rd step) 

• • • • 
• • • • 
• • • • 

12 Dots 



Marcy has to determine the number of dots in the 20th step, but she does not want to draw 
all 20 pictures and then count the dots. Explain or show how she could do this and give the 
answer that Marcy should get for the number of dots. 

Source: 1992 NAEP (grade 8) Percent correct: 6 

Scoring Guide 

Explanation should include one of the following ideas with no false statements. 



a. Eor each successive step, the number of rows and the number of columns is increasing by 
1, forming a pattern. Eor example, the first step forms 1 by 2 rows and columns, the next 
step 2 by 3, the third step 3 by 4, and so on. Continuing this pattern would mean that the 
20th step has 20 by 21 or 420 dots. 

b. Eook at the successive differences between the consecutive steps. The differences 4, 6, 8, 
10,... form a pattern. There are 19 differences forming the pattern 4, 6, 8, 10,... 38, 40 
and the sum is (9 x 44) + 22 or 418. However, 2 must be added for the first step, yielding 
a response of 420. 
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Scoring Rubric 
4 - Extended 

Correct answer. (Must state 420; must tie step 20 back to beginning of pattern in some specif- 
ic form of generalization.) 

3- Satisfactory 

Correct explanation of pattern but does not include or omits the correct number of dots. 

2- Partial 

A partial (incomplete) correct explanation, i.e., does not tie together. 

1 - Minimal 

Any attempt to generalize OR to draw all 20 pictures in the pattern (with a clear understand- 
ing of the pattern). 

0 - Incorrect 

The work is completely incorrect, irrelevant, or off. 



Jaime knows the following facts about points A, B, and C. 

• Points A, B, and C are on the same line, but might not be in that order. 

• Point C is twice as far from point A as it is from point B. 

Jaime concluded that point C is always between points A and B. 

Is Jaime’s conclusion correct? 

CD Yes CD No 

In the space provided, use a diagram to explain your answer. 



Source: 1996 NAEP (grade 8) 

Scoring Guide 


Percent correct: 23 


The explanation must include either one of the following diagrams: 


• 


• 


• 


c 


B 


A 




or 




• 


• 


— • — 


A 


B 


C 


Diagram should include or illustrate the idea that B is halfway between A and C. 
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Scoring Rubric 
1 - Correct 

Correct response. Both correct diagrams are given 
OR 

If correct diagram is clearly indicated either by circling and/or the incorrect ones are crossed 
out. 

0- Incorrect 

Any incorrect reason OR if there is no indication of which diagram is correct (by circling or 
crossing out incorrect one). 

NOTE: Points need to be indicated by some mark, such as a dot or tick mark. A response in which points are 
indicated by letters only is an automatic incorrect. 




In Mr. Bell’s classes, the students voted for their favorite shape for a symbol. 
Here are the results. 





Class 1 


Class 2 


Class 3 


Shape N 


9 


14 


11 


Shape P 


1 


9 


17 


Shape Q 


22 


7 


2 



Using the information in the chart, Mr. Bell must select one of the shapes to be the symbol. 
Which one should he select and why? 

The shape Mr. Bell should select: 

Explain: 

Source: 1996 NAEP (grades 4 and 8) Percent correct: 31 (grade 4); 58 (grade 8) 
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Scoring Guide 

Scoring Rubric 
1 - Correct 

N, because more students chose it. 

OR 

N, because it was first choice in one class and second choice in the other classes. 
“Majority” is acceptable (taken to mean most). If student says most classes, do not accept. 

0 - Incorrect 

Shape Q chosen, with an explanation that refers to a number of votes 
OR 

Shape N chosen, but explanation not given or is inadequate with incorrect computation. 
OR 

Any other incorrect response. 
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Appendix C 

NAEP Mathematics Project Staff and Committees 




NAEP Mathematics Project 
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Wayne Martin 
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Washington, D.C. 

John Olson 
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State Education Assessment Center 
Council of Chief State School Officers 
Washington, D.C. 

Frank Philip 

Senior Project Associate 
State Education Assessment Center 
Council of Chief State School Officers 
Washington, D.C. 

Linda D. Wilson 

Consensus Coordinator Consultant 
Council of Chief State School Officers 
Washington, D.C. 

Phoebe Winter 

Project Director 

State Education Assessment Center 
Council of Chief State School Officers 
Richmond, Virginia 

Subcontractors and Consultants 

Patricia Kenney 

Senior Research Associate 
University of Michigan 
Ann Arbor, Michigan 

Rebecca Kopriva 

Director 

Center for the Study of Assessment Validity 
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Department of Measurement & Statistics 
University of Maryland 
College Park, Maryland 



Christopher Cross 
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Washington, D.C. 

Kim Gattis 

President, Association of State Supervisors 
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Education Program Consultant, Kansas 
Department of Education 
Topeka, Kansas 

Linda Plattner 

Director of Policy, Standards & Instruction 
Council for Basic Education 
Washington, D.C. 

NAGB Staff 

Roy Truby 

Executive Director 

National Assessment Governing Board 
Washington, D.C. 

Sharif Shakrani 

Contracting Officer 

National Assessment Governing Board 

Washington, D.C. 

Mary Crovo 

Project Officer 

National Assessment Governing Board 
Washington, D.C. 

Steering Committee 

Eileen Ahearn 

Project Director 

National Association of State Directors 
of Special Education 
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Mathematics Education Consultant 
Michigan Department of Education 
Eansing, Michigan 

B. Marie Byers 

National School Boards Association 
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Randy DeHoff 

Colorado State Board of Education 
6th Congressional District-Littleton 
Denver, Colorado 

M.B. “Sonny” Donaldson 

Superintendent 
Aldine ISD 
Houston, Texas 

Janice Earle 
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National Science Foundation 
Arlington, Virginia 
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Division of Accountability Services 
North Carolina Department of Public 
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Bettye Forte 

Mathematics Consultant 
Arlington, Texas 

Matt Gandal 
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Achieve, Inc. 

Washington, D.C. 

Alice Gill 

Associate Director 
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Washington, D.C. 

M. Kathleen Heid 
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University Park, Pennsylvania 

Audrey Jackson 
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Director 
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Council of the Great City Schools 

Washington, D.C. 

Dane Linn 

Policy Studies Director 
National Governors’ Association 
Washington, D.C. 

Eddie Lucero 
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Albuquerque, New Mexico 

Lee McCaskill 
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Brooklyn Technical High School 
Brooklyn, New York 

Barbara Montalto 
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Texas Education Agency 
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Development 
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Committee Representation 
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